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FOREH^ORD 
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DIRECTIONAL  ERRORS  OF  MOVEMENTS 

AND  THEIR  CORRECTION  IN  A DISCRETE  TRACKING  TASK 

Robert  J.  Jaeger 
Cyan  C.  Agarwal 
Gerald  L.  Gottlieb 

College  of  Engineering 
University  of  Illinois  at  Chicago  Circle 
Chicago,  Illinois  60680 

and 

Rush  Medical  Center 
Chicago,  Illinois  60612 


ABSTRACT 


The  human  operator  is  prone  to  making  errors  in  quick  choice  reaction 
time  tasks.  Many  studies  have  shown  that  subjects  can  correct  their  own 
errors  of  movement  more  quickly  than  they  can  react  to  external  stimuli.  In 
the  control  of  movements,  three  general  categories  of  feedback  have  been 
defined  as  follows;  1)  Knowledge  of  results,  primarily  visually  mediated,  2) 
Proprioceptive  or  klnaesthetic  such  as  from  muscle  spindles  and  joint  recep- 
tors, and,  3)  Corollary  discharge  or  efference  copy  within  the  central  nervous 
system. 

Experiments  were  conducted  on  four  normal  human  subjects  to  study  the 
effects  of  these  feedbacks  on  simple  reaction  time,  choice  reaction  time,  and 
error  correction  time.  The  movement  used  was  plantarflexlon  and  dorsiflexlon 
of  the  ankle  joint.  The  feedback  loops  were  modified,  1)  by  changing  the  sign 
of  the  visual  display  to  alter  the  subject's  perception  of  results,  and  2)  by 
applying  vibration  at  100  Hz  simultaneously  to  both  the  agonist  and  antagonist 
muscles  of  the  ankle  joint.  The  central  processing  was  interfered  with  when 
the  subjects  were  given  moderate  doses  of  alcohol  (blood  alcohol  concentration 
levels  of  up  to  0.07%). 

Vibration  and  alcohol  Increase  both  the  simple  and  choice  reaction  times. 
However,  the  error  correction  time  is  not  influenced  by  either.  This  data 
reinforces  the  concept  that  there  is  a central  pathway  which  can  mediate  error 
correcting  responses. 


INTRODUCTION 


The  human  operator  is  prone  to  maklnu  errors  in  .t  quick  choice  reaction 
time  (RT)  task.  The  speed  with  which  the  operator  c.in  recognize  errors  and 
correct  them  is  an  important  consideration  in  many  Industrial  tasks.  Many 
siudies  have  shown  that  subjects  can  correct  errors  of  mi^ement  more  quickly 
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than  they  can  react  to  external  stimuli.  (For  a review  of  the  liter  v'-ui.  Pt  ' 
Schmidt,  1975,  1976;  Angel,  1976;  Schmidt  & Gordon,  1977.) 

In  the  control  of  movement  by  skeletal  muscles,  three  general  a:.gorles 
of  feedback  have  been  identified  (Evarts,  1971).  These  feedbacks  av’se  as 
follows:  first,  "knowledge  of  results"  from  the  external  environment  Ij.  ;rl- 
marily  visually  mediated.  Second,  proprioception  from  internal  receptors 
stimulated  as  a consequence  of  muscular  contraction  and  joint  rotation  is 
primarily  spindle  and  joint  receptor  mediated.  Third,  "efCerence  copy"  or 
"corollary  discharge"  (Von  Holst,  1953)  from  structures  and  pathways  within 
the  central  nervous  system  may  operate  before  muscle  contraction  occurs. 

Currently,  the  first  and  second  categories  of  feedback  are  perhaps 
better  understood  than  the  third,  although  the  role  of  efference  copy  in 
saccadic  eye  movements  has  received  considerable  attention  (Robinson,  1971, 
1976;  Lehmann,  1971).  These  three  categories  of  feedback  may  be  anatomically 
interconnected,  especially  the  proprioceptive  and  efference  copy  mechanisms 
(Oscarsson,  1970).  It  is  postulated  that  the  cerebellar  anterior  lobe  is 
important  for  correcting  errors  in  motor  activity  elicited  from  the  cerebral 
cortex  and  carried  out  by  command  signals  through  pyramidal  and  extrapyramidal 
pathways. 

Recent  work  of  Angel  and  his  colleagues  (Angel  & Higgins,  1969;  Angel, 
1976)  has  attempted  to  quantitatively  approach  efference  copy  by  measuring 
RTs  to  correct  movement  errors  and  the  accuracy  of  these  corrections.  It  has 
also  been  noted  (Poulton,  1974)  that  the  many  studies  which  have  measured  RTs 
for  the  correction  of  movements  have  found  these  times  to  range  from  essen- 
tially zero  to  in  excess  of  300  milliseconds. 

Since  a rather  wide  range  of  error  correction  times  exists,  it  could  be 
hypothesized  that  the  three  general  categories  of  feedback  each  have  their 
own  range  of  operating  times  which  together  contribute  to  the  overall  wide 
range  of  these  times.  Under  this  hypothesis,  if  a sufficient  number  of 
measurements  were  made,  a trimodal  distribution  might  be  found.  The  minimum 
duration  for  processing  visual  feedback  from  a movement  appears  to  be  over  190 
msec  (Keel  & Posner,  1968).  The  kinaesthetic  RT  is  of  the  order  of  120  msec 
(Chernikoff  & Taylor,  1952).  This  RT  is  of  the  same  order  as  the  time  for 
"Functional  Stretch  Reflex"  (Melville  Jones  & Watt,  1971;  Evarts,  1973; 

Gottlieb  & Agarwal,  1978),  Dewhurst  (1967)  has  reported  values  of  kinaesthetic 
RT  based  on  recordings  of  muscle  activity  in  the  biceps  as  short  as  50  msec. 
However,  he  did  not  give  any  range  for  kinaesthetic  RT  or  the  mean  value  in 
his  experiments. 

The  experiments  of  the  present  study  were  designed  to  enable  comparison 
of  correction  times  measured  under  normal  conditions  with  those  measured  under 
conditions  in  which  the  proprioceptive  mechanisms  was  interfered  with.  It  was 
possible  to  do  this  by  applying  vibration  to  the  tendons  of  the  muscles 
involved.  (Hagbarth  & Eklund,  1966;  Goodwin,  McCloskey  & Matthews,  1972; 
McCloskoy,  1973;  Craske,  1977).  In  some  experiments,  central  processing  was 
interfered  with  when  the  subjects  were  given  moderate  doses  of  alcohol  (blood 
alcohol  concentration  (BAG)  levels  of  up  to  0.07%).  Alcohol  produces  a depres- 
sive effect  on  the  CNb  niiich  as  a general  ane.sthetic  does  and  the  degree  of 
depression  appears  to  be  dose  related  fWallgren  & B.arry,  1970.) 


M£IrtOi>S 


Four  subjects  were  used  in  the  present  study.  Two  of  the  subjects  (GCA 
and  GLG)  had  extensive  previous  experience  with  the  experimental  apparatus  as 
subjects  in  other  tracking  type  experiments,  while  the  other  two  subjects  had 
no  such  experience.  Parts  of  these  experiments  were  also  done  on  several 
other  subjects. 

A schematic  of  the  experimental  apparatus  is  shown  in  Figure  1.  (This 
apparatus  has  been  used  in  several  studies,  for  details  see  Agarwal  & Gottlieb, 
1977). 

The  subject  sat  in  an  adjustable  height  chair  facing  an  oscilloscope 
display  positioned  at  a slight  angle  in  front  of  him,  His  right  foot  was 
strapped  to  a one  degree  of  freedom  foot  pedal  (rotation  in  plantar-dorsal 
directions)  with  velcro  straps.  Self  adhesive  surface  electrodes  were  posi- 
tioned over  the  soleus  and  anterior  tibial  muscles  to  record  the  electromyo- 
grams (EMGs)  of  these  muscles.  A ground  electrode  was  placed  on  the  thigh 
Just  proximal  to  the  knee.  The  EMGs  were  full  wave  rectified  and  filtered 
before  recording  on  the  digital  tape  ai  a sampling  rate  of  300  per  sec. 

The  oscilloscope  display  consisted  of  two  dots.  The  first  was  the  target 
dot  which  was  under  the  control  of  the  computer.  It  was  defocussed  to  ap- 
proximately 2 mm  diameter.  This  dot  assumed  only  one  of  three  positions  at 
any  instant  of  time,  either  in  the  center  of  the  screen  or  +4.0  cm  vertically 
away  from  the  center.  The  second  dot  was  the  response  dot  which  was  under  the 
control  of  the  subject.  It  was  focused  to  a sharp  point  approximately  0.5  mm 
in  diameter.  The  subject  could  vary  the  position  of  the  dot  continuously 
along  the  vertical  axis  of  the  oscilloscope.  The  crucial  part  of  the  experi- 
ment was  the  "polarity"  of  the  subjects'  control  of  the  response  dot.  This 
polarity  was  under  the  control  of  the  computer.  Normal  or  positive  polarity 
meant  that  when  the  subject  moved  the  pedal  down  (up)  the  response  dot  also 
moved  down  (up).  Inverted  or  negative  polarity  meant  that  when  the  subject 
moved  the  pedan  down  (up) , the  response  dot  moved  up  (down) . The  purpose  of 
this  provision  for  polarity  reversal  was  do  decouple  the  proprioceptive  feed- 
back from  the  visual  feedback  and  induce  the  subject  to  make  errors  in  move- 
ment. The  use  of  polarity  reversal  has  been  previously  described  by  Gibbs 
(1965)  and  Angel  and  Higgins  (1969). 

The  target  dot  was  controlled  by  the  computer  as  follows.  The  experiment 
began  with  the  target  dot  in  the  center.  After  a random  delay  of  3 to  5 sec, 
the  target  dot  stepped  randomly  up  or  down.  The  now  position  was  maintained 
for  a random  period  of  3 to  5 sec  and  then  returned  to  center.  Ten  initial 
trials  stepping  out  and  returning  to  zero  were  performed  at  normal  polarity. 
Following  these  ten  initial  trials,  the  computer  reversed  the  polarity  of  the 
response  dot.  A random  number  (8  to  12)  trials  were  performed  at  the  revei'.»ed 
polarity,  after  which,  the  polarity  again  reversed  for  the  next  group  of 
trials.  The  response  immediately  following  a polarity  reversal  was  always 
discarded,  since  it  could  be  expected  to  contain  a higher  proportion  of 
visually  mediated  error  corrections  than  other  responses. 

This  scheme  of  target  dot  movement  also  provided  the  opportunity  to  study 
simple  and  choice  RTs,  since  the  majority  of  responses  were  correct.  When  the 
target  dot  moved  from  the  center.  It  moved  randomly  up  or  down,  forcing  the 
subject  to  choose  before  reacting.  When  the  target  dot  next  moved,  it  always 


returned  to  zero,  allowing  the  subject  to  make  a simple  reaction. 

The  subjects  were  Instructed  to  make  the  response  dot  follow  the  movement 
of  the  target  dot  as  quickly  as  possible  with  as  much  accuracy  as  possible, 
but  to  favor  a fast  response. 

In  the  vibration  experiments,  two  Hagbarth  type  vibrators  (TVR  vibrator  - 
model  #TMT-18,  Helwa  Electronic  Industrial  Comp.,  Japan)  were  attached  to  the 
distal  tendons  of  soleus  and  anterior  tibial  muscles  (just  above  the  ankle 
joint)  with  surgical  tape.  The  vibrators  were  operated  at  100  Hz  continuously 
during  the  tracking  task. 

In  the  alcohol  experiments,  the  subjects  were  given  alcohol  proportional 
to  the  body  weight  such  that  the  ultimate  BAC  was  in  the  range  of  0.06  to 
0.07%.  The  BAC  was  measured  using  a Mark  II  Intoximeter  (Gas  Chromatography 
Unit  by  Intoximeters,  Inc.). 

The  measurement  of  the  RTs  were  done  off  line  by  displaying  the  Indivi- 
dual responses  on  a four  channel  oscilloscope  using  a cursor  to  indicate  the 
time  measurement  after  the  input.  The  accuracy  of  these  measurements  is 
equal  to  the  sampling  Interval,  i.e.,  2 msec.  The  RTs  measured  are  indicated 
in  Figures  2 and  3. 

The  statistical  analysis  included  means  and  variances  of  the  sample  data 
and  the  t-test  of  equality  of  the  means  of  two  samples  whose  variances  are 
assumed  to  be  unequal  (Sokal  & Rohlf,  1969,  Chapter  13). 


RESULTS 


Data  were  collected  on  separate  days  for  each  subject  and  for  each  exper- 
imental paradigm.  The  first  day  experiment  was  always  under  normal  conditions. 
Typical  responses  are  shown  In  Figure  2 for  a correct  response  in  a choice  RT 
and  for  error  response  in  Figure  3.  The  four  traces  are  the  angular  rotation 
(6),  EMGs  of  the  anterior  tibial  (AT)  and  gastrocnemius-soleus  (GS)  muscles 
and  the  angular  velocity  (6).  The  angular  velocity  was  obtained  by  digital 
differentiation  of  angular  rotation.  The  simple  ami  choice  RTs  (SRT  & CRT), 
the  error  reaction  time  (ERT),  and  the  error  correct 'on  time  (ECT)  were 
measured  using  both  the  EMG  and  velocity  data.  In  the  following  tables  only 
the  EMC  related  measurements  are  reported.  The  final  conclusions  would  have 
been  exactly  the  same  using  the  velocity  data. 

Table  I shows  the  simple  and  choice  reaction  times  under  normal  condi- 
tions with  positive  and  negative  polarity  movements.  With  the  exception  of 
subject  GA,  and  GG's  SRT,  the  RTs  for  the  other  three  subjects  with  positive 
and  negative  polarity  were  not  significantly  different.  In  general  there  was 
a slight  increase  In  the  RTs  wltli  negative  polarity.  Since  the  RT  differences 
with  alcohol  and  vibration  were  more  significant,  the  positive  and  negative 
polarity  data  was  lumped  together. 

Table  II  shows  SRTs  fur  all  subjects  in  three  paradigm  conditions.  Note 
that  in  general,  alcohol  as  well  as  vibration  increased  the  SRT.  This  is  also 
true  for  CRT  shown  in  Table  III.  The  t-test  comparisons  are  made  be,  r.n  the 
normal  and  altered  conditions.  In  Table  ll,  six  out  of  eight  t-test  values 
are  significant  at  P O.Ol  level.  In  Table  III,  seven  out  of  eight  t-test 
values  are  significant  at  P < 0.01  level. 

Table  IV  shows  the  error  reaction  times  in  the  three  paradigm  conditions. 
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Most  errors  occured  in  the  choice  reaction  condition.  There  was  a significant- 
ly larger  number  of  errors  with  negative  polarity  than  with  positive  polarity 
feedback.  The  error  rates  for  the  two  conditions  ranged  between  16%  and  33%. 

In  these  data,  four  out  of  eight  t-test  values  show  significant  differences  at 
P < 0.01  level. 

Table  V compares  the  data  from  Tables  III  and  IV  for  choice  RT  and  error 
RT  under  normal  conditions.  Note  that  error  RTs  are  larger  than  the  choice 
RTs  and  only  one  out  of  four  t-test  values  show  significant  differences  at 
P < 0.01  level. 

Table  VI  shows  the  error  correction  times  for  the  four  subjects  under 
our  three  paradigms.  The  error  correcLion  time  is  significantly  less  than  the 
choice  or  error  RT.  None  of  the  eight  t-test  values  between  normal  and  altered 
conditions  show  significance  at  P < 0.01  level. 

Table  VII  shows  the  error  rates  for  individual  e:rperiments  as  well  as 
combined  error  rates  for  all  subjects.  The  vibration  input  did  not  influence 
the  error  rates.  Alcohol  tended  to  increase  the  error  rates  in  three  out  of 
four  subjects  but  the  t-test  values  do  not  indicate  any  significance.  For 
n “ 4 the  t-test  values  are  not  very  meaningful. 


DISCUSSION 


The  paradigm  of  incompatible  display  has  been  used  by  Gibbs  (1965),  Angel 
& Higgins  (1969),  and  Angel  (1976).  There  is  a clear  increase  in  the  SRT  as 
well  as  CRT  with  negative  polarity  display  (Table  I).  This  increase  was 
significant  at  P < 0.01  level  for  subjects  GA  and  GG  whose  RTs  were  fastest. 

The  significance  of  positive  and  negative  polarity  disappeared  with  increased 
RT  of  subject  RJ  and  FM. 

Vibration  and  alcohol  increases  both  the  SRT  and  CRT  for  correct  movements 
as  compared  to  the  normal  condition  (Tables  II  and  III).  Carpenter  (1962)  has 
reviewed  the  literature  on  the  effects  of  alcohol  on  psychological  processes 
and  concluded  that  in  most  studies,  RT  is  lengthened  at  relatively  low  blood 
alcohol  levels.  Vibration  of  a tendon  in  humans  causes  a predictable  increase 
in  the  contractile  activity  of  the  agonist,  caused  by  autogenous  reflex  exci- 
tation of  the' alpha  motoneuron  (Hagbarth  & Eklund,  1966).  This  leads  to 
involuntary  movements  and  illusion  of  movements  (Goodwin  et  al  1972;  McCloskey, 
1973;  Craske,  1977).  In  our  experiments,  vibrators  were  attached  to  both 
agonist-antagonist  tendons  and  subjects  reported  numbness  in  the  vibrated  ankle 
joint.  The  significant  increase  in  the  SRT  and  CRT  with  vibration  could  indi- 
cate that  large  irrelevant  position  signals  from  the  vibrated  joint  delays 
processing  cf  visual  information  and  command  selection. 

Tables  IV  and  V show  that  the  choice  reaction  time  and  the  error  reaction 
time  (initial  movement  in  the  wrong  direction)  are  not  significantly  different 
under  normal  conditions.  This  agrees  with  Gibbs  (1965)  findings  that  the 
response  latencies  of  correct  and  incorrect  responses  were  virtually  equal  on 
equiprobable  steps.  Although  the  response  latencies  for  the  four  subjects  are 
significantly  different,  there  is  no  correlation  between  the  response  latencies 
and  the  errors  of  subjects  (see  Table  VII),  i.e.,  the  subjects  who  responded 
most  rapidly  did  not  make  the  most  errors  (Gibbs,  1965).  The  ERT  in  most 
cases  is  longer  than  the  CRT,  suggesting  that  there  was  no  temporal  anticipa- 
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tion  of  the  target  (A  paradigm  which  has  been  used  by  Schmidt  and  Gordon  (1977) 
in  their  study). 

The  surprising  result  of  this  study  is  that  whereas  the  SRT  and  CRT  are 
Influenced  (Increased)  by  vibration  and  alcohol,  the  error  correction  times 
are  not  significantly  affected  as  given  in  Table  VI.  The  average  error  correc- 
tion time  is  shorter  than  the  CRT  for  individual  subjects.  This  is  in  agree- 
ment with  findings  by  Gibbs  (1965),  Rabbitt  (1966),  and  Angel  and  Higgins 
(1969),  Megaw  (1972),  and  Angel  (1976). 

The  histograms  of  error  correction  times  for  the  four  subjects  under  three 
paradigm  conditions  are  shown  in  Figure  4.  For  subjects  GA  and  GG  who  had  the 
most  experience  in  tracking  studies,  most  errors  are  corrected  in  less  than 
250  msec,  i.e.,  less  than  their  normal  choice  reaction  times.  For  subject  RJ 
a significant  number  of  ECTs  are  larger  than  250  msec.  For  subject  FM,  his 
RTs  were  the  slowest  and  larger  percentage  of  ECTs  are  above  250  msec. 

The  conclusion  of  Higgins  & Angel  (1970)  and  Angel  (19/6)  that  the  origin 
of  feedback  from  error  responses  is  central  rather  than  klnaesthttic  is  rein- 
forced by  the  invariance  of  ECTs  with  vibration  on  the  limb.  The  vibration 

Increases  the  SRTs  and  CRTs  which  implies  an  influence  of  the  ) erlpheral  input 

in  motor  command  decision  making. 

Alcohol  which  is  known  to  produce  a depressive  effect  on  the  CHS  also 
increases  the  SRTs  and  CRTs  but  does  not  significantly  influence  the  ECTs  with 

BAC  levels  of  0.07%  or  less  used  in  these  experiments. 
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TABLE  1;  Effect  of  Display  Polarity  on  Simple  and  Choice  Reaction  Times 

Positive  Polarity  NEGATIVE  POLARITY 

SUBJ  MEAN  SD  N t MEAN  SD  N 


Simple  Reaction  Times 


GA 

216 

32 

113 

-3.99* 

248 

78 

110 

GG 

222 

51 

129 

-2.52* 

240 

71 

164 

RJ 

270 

76 

130 

-1.42 

283 

78 

156 

FM 

359 

75 

133 

0.59 

354 

69 

161 

Choice  Reaction  Times 

GA 

235 

57 

98 

-2.79* 

272 

102 

73 

GG 

256 

42 

111 

-2.00 

271 

70 

122 

RJ 

268 

80 

83 

-1.12 

282 

84 

90 

FM 

338 

76 

112 

-1.46 

359 

69 

112 

*P  < 0.01 

TABLE  II; 

Simple 

Reaction  Times 

SUBJ 

VIBRATION 
MEAN  SD  N 

t 

MEAN 

NORMAL 

SD 

N 

t 

MEAN 

ALCOHOL 

SD 

N 

GA 

246 

45 

150 

-5.99* 

219 

39 

233 

-4.48* 

235 

42 

297 

RJ 

316 

92 

156 

-4 . 50* 

277 

77 

286 

-7.75* 

333 

96 

269 

FM 

371 

78 

274 

0.58 

375 

86 

294 

-5.68* 

420 

98 

256 

GG 

311 

84 

164 

-10.46* 

232 

64 

293 

-1.24 

240 

54 

290 
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TABLE  III;  Choice  Reaction  Times 


VIBRATION  NORMAL  ALCOHOL 


SUBJ 

MEAN 

SD 

N 

t 

MEAN 

SD 

N 

t 

MEAN 

SD 

N 

GA 

317 

111 

131 

-5.58* 

253 

80 

171 

-0.64 

258 

59 

152 

RJ 

333 

83 

98 

-5.27* 

277 

86 

173 

-8.25* 

355 

88 

166 

FM 

409 

96 

211 

-7.43* 

348 

73 

224 

-11.28* 

443 

100 

212 

GG 

330 

85 

136 

-6.98* 

272 

61 

233 

-3.34* 

288 

61 

230 

TABLE  IV; 

Error  Reaction 

Times 

VIBRATION 

NORMAL 

ALCOHOL 

SUBJ 

MEAN 

SD 

N 

t 

MEAN 

SD 

N 

t 

MEAN 

SD 

N 

GA 

274 

60 

19 

-1.03 

257 

62 

47 

-0.56 

263 

59 

104 

RJ 

342 

65 

55 

-2.90* 

311 

55 

80 

-3.57* 

343 

69 

111 

FM 

387 

75 

59 

-1.83 

363 

72 

68 

-5.72* 

443 

70 

41 

GG 

332 

84 

32 

-2.42* 

289 

63 

42 

-0,08 

290 

60 

45 

TABLE  V;  Comparison  of  CRTS  with  ERTb  under  Normal  Conditions 

CHOICE  ERROR 

REACTION  TIMES  REACTION  TIMES 


SUBJ 

MEAN 

SD 

N 

t 

MEAN 

SD 

N 

GA 

253 

80 

171 

-0.37 

257 

62 

47 

RJ 

277 

86 

173 

-3.79* 

311 

55 

80 

FM 

348 

73 

224 

-1.50 

363 

72 

68 

GG 

272 

61 

233 

-1.62 

289 

63 

42 
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SUBJ 

TABLE  VI; 

VIBRATION 

MEAN  SD  N t 

Error  Correction  Times 
NORMAL 

MEAN  SD  N t 

ALCOHOL 

MEAN  SD  N 

GA 

137  69 

19  0.32 

143 

72 

47 

0.67 

135 

59 

104 

RJ 

194  101 

55  -1.71 

166 

81 

80 

-1.62 

186 

88 

111 

FM 

259  72 

59  2.18 

293 

103 

68 

2.23 

251 

90 

41 

GG 

170  84 

32  -0.05 

169 

72 

42 

-0.68 

150 

74 

45 

TABLE 

VII:  Rate  of 

Errors  in  Percent 

SUBJ 

VIBRATION 

NOPJIAL  ALCOHOL 

GA 

0.063 

0.107 

0.188 

RJ 

0.178 

0.148 

0.203 

FM 

0.110 

0.116 

0.081 

GG 

0.096 

0.074 

0.080 

VIBRATION 

t 1 

NORMAL 

t 

ALCOHOL 

MEAN 

0.112 

-0.04 

0.111 

-0.74 

0.138 

SD 

0.048 

0.030 

0.067 

N 

4 

4 

4 
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Figure  1 

A schematic  of  the  experimental  apparatus.  Electromyograms  (EMGs)  are 
measured  using  disk  surface  electrodes  placed  over  the  bellies  of  the  gastro- 
cnemius- soleus  and  anterior  tlblal  muscles,  EMG  amplifiers  (A)  are  differen- 
tial amplifiers  (bandwidth  60-600  Hz),  filters  (F)  are  third  order  averaging 
(10  msec  averaging  time),  display  oscilloscope  (D)  Is  a dual-beam  Tektronix 
502,  digital  computer  (C)  is  a General  Automation  SPC016/65.  The  torque 
motor  (M)  and  the  torque  measurements  (t)  were  not  used  In  these  experiments. 
The  angular  rotation  (6)  Is  measured  by  a continuous  transformer- type 
transducer,  this  signal  is  fed  Into  the  computer  on  an  A/D  Input  channel 
multiplied  by  +1  or  -1  and  outputed  on  D/A  channel.  This  channel  is  operated 
independent  of  the  data  channels  at  a rate  of  I KHz. 
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Figure  2 

Typical  response  in  a choice  reaction  with  a display  gain  of  +l  and  a 
movement  from  central  position  to  plantarflexlon  of  the  ankle  joint.  The 
choice  reaction  time  (CRT)  is  measured  from  the  Jump  of  the  target  to  the 
first  EMC  burst  in  gastrocnemius-soleus  (GS)  muscle.  There  is  no  EMC 
activity  in  the  anterior  tlbial  (AT)  muscle.  Total  display  time  is  I sec. 
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Figure  3 

Typical  response  In  error  movement  and  subsequent  correction.  The 
display  polarity  Is  again  +1.  The  error  reaction  time  (ERT)  and  error 
correction  time  (ECT)  are  measured  from  the  Initial  burst  in  the  antagonist 
and  agonist  muscle  EMGs.  Total  display  time  Is  1 sec. 
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Figure  4 

Histograms  of  the  error  correction  times  (ECTs)  for  the  four  subjects 
under  normal  (N),  alcohol  (A)  and  vibration  (V)  input  paradigms.  The  time 
interval  on  abclssa  is  500  msec,  (continued  on  next  page) 
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SUMMARY 


This  paper  deals  with  the  effect  of  the  spectrum  of  the  forcing  fiuic- 
tion  on  the  human  pilot  dynamics  in  manual  control.  A simple  compensatory 
tracking  experiment  was  conducted,  where  the  controlled  element  was  of  a 
second-order  dynamics  and  the  forcing  function  was  a random  noise  having  a 
dominant  frequency.  The  dominant  frequency  ajid  the  power  of  the  forcing 
function  were  two  variable  parameters  during  our  experiment. 

The  results  show  that  the  human  pilot  describing  functions  are  dependent 
not  only  on  the  dynamics  of  the  controlled  element,  but  also  on  the  charac- 
teristics of  the  forcing  function.  This  suggests  tliat  the  human  pilot  be- 
havior should  be  expressed  by  the  transfer  function  taking  into  consideration 
his  ability  to  sense  and  predict  the  forcing  function. 


SYMBOLS 


Aij(k) 

element  of  k-th  autoregressive  coefficient  matrix 

B 

backward  shift  operator 

c{t),  c(n) 

human  pilot  output 

dB 

decibel 

e(t),  e(n) 

displayed  error 

i(t),  i(n) 

forcing  function 

Kf 

static  gain  of  forcing  function  filter 
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M 


order  of  autoregressive  model 


m(t),  m(n) 

s 

Yf(ju)) 

Yp(juj) 

A 

U)f 

Wn 


controlled  element  output 
variable  of  Laplace  transform 
controlled  eleme*nt 
forcing  function  filter 
human  pilot  describing  function 
sampling  interval 

damping  of  forcing  function  filter 
damping  of  controlled  element 
power  of  forcing  function 

undamped  natural  frequency  of  forcing  function 
undamped  natural  frequency  of  controlled  element 

INTRODUCTIOM 


It  is  well  kno\m  that  when  a hiiman  piiot  controls  the  system,  his 
control  behavior  depends  on  the  characteristics  of  the  forcing  function  to 
the  system  as  well  as  of  the  controlled  element  itself.  A great  number  of 
papers  have  been  published  on  this  problem. 

Concerning  the  effect  of  the  characteristics  of  the  controlled  el  -nent 
on  pilot  behavior,  Washizu  and  Miyajima  (reference  1),  and  Goto  and  Lzu 
(reference  2)  pointed  out  in  a series  of  study  on  manual  contrt»l  of  a second- 
order  system  that  the  human  pilot  takes  notice  of  the  periodicity  in  the 
response  of  the  controlled  element,  if  any,  and  makes  use  of  it  to  improve 
his  control  performance. 

On  the  other  hand,  concerning  the  effect  of  the  forcing  function  on 
pilot  behavior,  McRuer  and  Krendel  (reference  3)  pointed  out  that  as  the 
bandwidth  of  the  forcing  function  increases,  the  effective  time  delay  re- 
duces probably  due  to  the  muscular  reaction  characteristics  of  the  human 
pilot. 

The  purpose  of  the  present  paper  is  to  investigate  the  effect  of  the 
forcing  fmiction  spectrum  on  the  human  pilot  dynamics  in  manual  control.  A 
simple  compensatory  tracking  experiment  was  conducted,  where  the  controlled 
element  was  of  the  second-order  dynamics  and  the  forcing  function  was  a 
random  noise  having  a dominant  frequency.  The  dominant  frequency  and  the 
power  of  the  forcing  function  were  two  variable  ijarameters  during  the  experi- 
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merit.  Pilot  describing  functions  were  derived  from  the  autoregressive  model 
coefficients  identified  using  the  Akaike’s  Final  Prediction  Error  method. 


EXPERIMENT 


The  ;?ystem  of  our  experiment  was  built  up  with  an  analogue  computer,  an 
oscilloscope  and  a control  stick  with  a restoring  spring.  Its  block  diagi'am 
is  as  shown  in  figure  1.  The  error  e(t)  was  displayed  on  the  oscilloscope 
by  a line  segment  moving  vertically.  The  pilot  was  requested  to  minimize 
the  error  to  the  best  of  his  ability.  The  controlled  element  had  a second- 
order  stable  dynamics,  and  its  transfer  function  was  of  the  form; 

0)  ^ 

Yc(s)-~2 2 

r.  +PCn^nS+Wyj 


The  damping  Cn  undamped  natural  frequency  of  the  controlled  element 
were  held  fixed  throughout  our  experiment  such  as. 


C = 0.1 

n , 

0)  =/20  = 
n 


(rad/sec)  . 


The  shaping  filter  of  the  forcing  function  also  had  a second-order  stable 
dynamics  as. 


Y^(s) 


2 2 


(2) 


where  the  damping  Cf  was  held  fixed  to  0.1  and  the  static  gain  Kf  and  the 
undamped  natural  frequency  were  two  variable  parameters.  Thus,  the  white 
noise  was  transformed  into  a forcing  function  having  a dominant  frequency 
after  passing  the  filter.  The  dominant  frequency  was  varied  by  selecting  the 
values  of  as, 

0)^  = 3.l6,  2.2U,  1,58  (rad/sec)  . 

We  chose  Po'ir  levels  for  the  power  of  the  forcing  function  by  adjusting 
Kf  of  the  equation. 
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0 


2 

i 


VjL 


(3) 


wfiere  is  the  power  of  the  noise  source. 

The  expel  iment  was  of  12  cases,  namely  3 kinds  of  frequencies  and  h 
power  levels  of  the  forcing  function,  and  two  runs  of  each  case  were  perform- 
ed. After  sufficient  excercise,  the  analog  data  of  the  Icxigth  of  90 
seconds  for  each  runs  were  recorded.  The  data,  i(t),  e(t),  c(t)  and  m(t) 
in  figure  1 were  transformed  into  digital  data  by  use  of  the  NOVA  mini- 
computer system.  The  FACOM  230-75  computer  was  employed  for  numerical  calcu- 
lations of  the  following  time  series  analysis. 


ANALYSIS 


By  the  use  of  the  experimental  data  thus  obtained,  the  human  pilot 
describing  functions  were  identified  utilizing  a time  domain  technique;  tl at 
is,  an  autoregressive  model  was  fitted  to  the  data  by  using  the  Akaike’s 
MP’PE  (Multiple  Final  Prediction  Error)  method,  (reference  k) 

In  the  first  place,  the  data  were  sampled  from  the  analog  data  of  the 
pilot  output  c(t)  and  the  error  e(t)  with  the  sampling  interval  A,  which  was 
set  as  0.1  sec.  The  sampled  data  are  denoted  by  c(n)  and  e(n).  Then,  the 
autoregressive  model  of  the  fonri; 


✓ 

y N 

c(n) 

Aii(B) 

c(n) 

+ 

‘^ll  '^12 

e(n) 

A^^(B)  A (B) 

e{n) 

^22 

) 

s J 

2 M 

+ a^j(2)B  + + a^j(M)B 

Bx(n)  = x(n-l) 


(5) 

(6) 


(U) 


wfxi?  fitted  to  the  given  data.  B is  the  backward  shift  operator  as  shown  in 
equation  (6),  and  A^j(B)'s  in  equation  (4)  are  the  power  series  in  B that 
are  made  up  of  the  autoregressive  model  coefficients  aij(k)  with  k going 
from  1 through  M.  The  order  of  the  model  M is  determined  by  the  MFPE 
tiu-thod.  Ci(n)'s  in  equation  (4)  are  mutually  independent  white  noises. 

Once  we  have  succeeded  in  fitting  the  model  to  the  given  data,  namely, 
^ \2  ~ ® we  can  compute  the  pilot  describing  function  using 
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(7) 


(jo.)  = 


1 - jw) 


> 


where  obtained  from  Aj^i(B)  and  A3^2(B)  in  equation  (U) 

respectively,  by  replacing  B with  exp(-jwA). 


This  method  has  recently  been  put  into  practical  use,  and  our  experience 
in  using  it  has  proved  that  it  is  quite  efficient  and  powerful  (reference  5)* 
Application  of  this  method  to  our  data  was  also  successful,  as  the  estimated 
correlation  coefficient  of  the  noise  sources,  O12/  ^ ^11^22^  quite  small. 


RESULTS 


Figures  2 and  3 are  examples  of  the  time  histories  of  the  records. 

Note  that  in  figure  2,  namely  when  the  frequency  of  the  forcing  function 
was  large,  it  is  not  evident  that  c(t)  was  affected  by  the  forcing  function 
periodicity.  The  pilot  seemed  to  suppress  only  the  controlled  element 
periodicity. 

On  the  other  hand,  figure  3 shows  the  time  history  of  the  case  when 
was  relatively  small.  In  this  case,  it  is  evident  that  c(t)  was  made  up  of 
two  main  sinusoidals;  one  reflected  the  forcing  function  periodicity  and  the 
other  reflected  the  pilot  behavior  which  seemed  to  suppress  the  controlled 
element  periodicity.  This  suggests  that,  when  uif*  was  relatively  small,  the 
human  pilot  behavior  was  affected  by  the  forcing  function. 

Above  tendencies  can  be  seen  more  obviously  in  the  power  spectrum 
densities  of  the  pilot  output  as  shown  in  figure  namely  in  the  vicinty  of 

0)  = the  power  spectra  were  pulled  up  as  increased,  and  this  phenome- 
non became  more  conspicuous  when  was  relatively  small. 

Typical  pilot  describing  functions  are  shown  in  figures  5 and  6.  From 
these  figures,  the  following  tendencies  have  been  observed; 

1)  If  the  power  of  the  forcing  function  is  increased,  while  keeping 
the  undamped  natural  frequency  (lij*  unchanged,  the  gain  of  the  pilot  des- 
cribing function  increases,  but  the  phase  lead  becomes  smaller  in  the 
frequency  region  below  the  undamped  natural  frequency  of  the  controlled 
element  0^* 

2)  If  the  frequency  of  the  forcing  function  o)f  is  decreased,  while  keeping 
the  power  unchanged,  the  gain  of  the  pilot  describing  function 
increases,  but  the  phase  lead  becomes  smaller  in  the  low  frequency  range, 
especially  in  the  neighbourhood  of  the  undamped  natural  frequency  of  the 
forcing  function. 
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Figure  7 shows  the  performance  of  the  pilot  control  indicated  by 
It  is  evident  that  the  smaller  the  undamped  natural  frequency  was,  the 
blotter  the  performance  became.  This  implies  that  when  uif  was  small,  the 
pilot  could  easily  recongnize  the  forcing  function  periodicity,  and  his 
task  became  easier. 

These  results  lead  to  the  following  consideration  concerning  the  for- 
cing function  effects  on  human  pilot  control  behavior. 

The  effect  of  the  forcing  function  bandwidth  on  the  pilot  describing 
function  is  reported  in  reference  3.  It  is  pointed  out  in  the  report  that 
the  effective  time  delay  of  the  human  pilot  decreases  as  the  bandwidth  of  the 
forcing  function  increases. 

On  the  other  hand,  the  present  study  put  emphasis  on  the  effect  of  the 
frequency  wp  and  Kp  of  the  forcing  function  shaping  filter.  It  has  been 
suggested  that  the  increase  in  the  power  of  the  forcing  function  is  likely 
to  work  so  as  to  make  the  pilot  employ  the  control  that  takes  into  account 
the  dominant  periodicity  in  the  forcing  function.  The  attempt  to  suppress 
the  dominant  frequency  component  may  lead  to  the  reduction  of  the  power  of 
the  error.  It  has  also  been  suggested  from  the  present  study  that  if  the 
response  of  the  controlled  element  and  the  forcing  function  have  periodici- 
ties, the  human  pilot  would  try  to  augment  the  system  stability  by  making 
use  of  the  periodicity  in  the  response  of  the  controlled  element,  and  then, 
try  to  make  the  performance  as  good  as  possible  by  making  use  of  the  periodi- 
city of  the  forcing  function.  Especially,  if  the  power  of  the  forcing 
function  is  large  and  the  two  natural  frequencies  are  separated,  it  would 
be  easy  for  the  pilot  to  notice  these  frequencies  and  to  make  use  of  these 
frequencies  in  the  control. 

The  present  study  has  shown  that  the  human  pilot  dascribing  functions 
are  dependent  not  only  on  the  natural  frequency  of  the  controlled  element, 
but  also  on  the  frequency  and  the  power  of  the  forcing  function.  These 
results  seem  to  suggest  that  the  human  pilot  control  behavior  couldn't  be 
expressed  by  a simple  transfer  function  compensating  the  controlled  element 
delay  only,  but  should  be  expressed  by  the  transfer  function  taking  into 
consideration  his  ability  to  sense  and  predict  the  forcing  function. 


CONCLUDING  REMARKS 


The  results  show  the  effects  of  the  forcing  function  on  the  human  pilot 
such  as; 

1)  If  the  power  of  the  forcing  function  Oi^  increases,  the  gain  of  the 
human  describing  function  |Yp|  increases,  but  the  phase  lead  of  Yp 
becomes  smaller  at  U)  < Wn. 

2)  If  the  undamped  natural  frequency  of  the  forcing  function  de- 
creases, the  gain  |Yp|  increases  but  the  phase  lead  of  Yp  becomes 
smaller  especially  in  the  vicinity  of  u)  = Wf. 
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3)  The  human  pilot  seems  to  try  to  augment  the  system  stability  and 
make  the  performance  better  by  use  of  and  Wp,  especially  when  Oj^ 
is  large,  and  and  Up  are  separated. 
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figure  1.  Block  Diagram  of  the  Experiment 


N> 


Figiire  2.  An  Example  of  the  Ti 
( 0)^  = 3.16  rad/sec. 


Forcing  Function  Periodic  Time  = 2ir/(o.  = 3.97  sec 

Controlled  Element  Periodic  Time  = 2ir/tu  =1.U0  sec 

n 

Figure  3.  to  Example  of  the  Time  Histories  of  the  Recorded  Data 
( <0  = 1.58  rad/sec,  and  = 2.00  ) 
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Figure  5*  Comparison  of  Pilot  Frequency  Responses  when  Wj,"3.l6  rad/sec» 
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Figure  6.  Comparison  of  Pilot  Frequency  Responses  when  rsd/sec 
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SUMMARY 


It  is  very  difficult  (or  even  Impossible)  for  a human  to  control  plants 
of  third  order  or  more  with  little  or  no  damping  by  just  knowing  the  instan- 
taneous error.  It  has  been  shown  that  adding  first  and/or  higher  order  deri- 
vatives to  the  error  signal  and  displaying  the  combined  signal  are  effective 
in  facilitating  human  control  over  such  plants signal  quickening  by  Birming- 

ham and  Taylor.  Their  technique  is  further  extended  to  incorporate  the  future 
trajectory  variation  into  the  displayed  signal  so  as  to  minimize  the  tracking 
error.  A method  for  tuning  free  parameters  in  ordinary  and  extended  quicken- 
ing is  established  by  applying  discrete-time  optimal  control.  Experimental 
results  for  a triple  integrator  plant  indicate  the  effectiveness  of  the  pro- 
posed method  to  achieve  high  quality  tracking. 


INTRODUCTION 


It  is  known  to  be  very  difficult  for  a human  to  control  higher  order 
plants  with  little  or  no  damping  with  conventional  compensatory  or  pursuit 
display  (reference  1).  To  facilitate  human  control  over  such  plants,  Birming- 
ham and  Taylor  (reference  2)  proposed  to  Incorporate  the  derivatives  of  the 
plant  output  into  the  displayed  signal.  The  technique  is  called  "signal 
quickening,"  and  its  effectiveness  has  been  demonstrated.  This  can  sometimes 
be  done  as  shown  in  figure  1 for  a triple  integrator  plant.  When  the  refer- 
ence trajectory,  r(t),  is  constant,  the  quickened  display  makes  it  possible  to 
achieve  high  quality  regulation.  However,  if  r(t)  is  time  varying,  it  can  not 
be  expected  that  high  quality  tracking  be  achieved  with  the  quickened  display. 
This  is  because  the  human  operator  and  plant  Introduce  phase  shifts  between 
the  reference  trajectory  and  the  plant  output.  To  Improve  the  tracking  per- 
formance, more  information  on  the  reference  trajectory,  such  as  derivatives, 
future  values,  etc.,  is  needed. 

In  many  manual  control  situations,  the  reference  trajectory  is  predeter- 
mined, or  a portion  of  future  reference  trajectory  can  be  detected  in  advance 
if  not  all  future  information  is  available.  In  such  cases,  the  preview  dis- 
play in  figure  2 has  been  shown  to  improve  the  tracking  performance  when  the 
plant  is  relatively  easy  to  control  (references  3,  4 and  5).  If  the  plant  is 
higher  order  and  weakly  damped,  preview  information  alone  is  not  sufficient 
to  achieve  high  quality  tracking  or  even  to  stabilize  the  plant. 

After  noticing  the  limitations  of  quickened  display  and  preview  display, 
one  may  propose  to  combine  those  two  and  use  a display  as  illustrated  in  fig- 
ure 3.  Hot^ever,  this  scheme  is  not  good  for  tracking  since  with  such  a dis- 
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play  the  human  operator  tries  to  match  the  distorted  plant  output  with  the 
reference  trajectory.  A better  approach  is  to  process  future  trajectory  inf- 
ormation by  computer  to  generate  a distorted  reference  signal  which  is  compat- 
ible to  the  distorted  plant  output.  This  scheme  is  Illustrated  in  figure  4 and 
is  named  "extended  quickening".  Due  to  innovations  in  microcomputer  technolo- 
gy, this  kind  of  digital  data  processing  is  not  difficult  nor  e:q>ensive.  The 
design  of  extended  quickened  displays  involves  the  determination  of  the  feed- 
back (quickening)  gains,  a^'s,  and  feedforward  or  preview  gains,  b)2,'s,  such 
that  high  quality  tracking  is  assured.  A design  method  based  on  discrete-time 
optimal  control  is  presented  in  the  next  section. 


DESIGN  OF  EXTENDED  QUICKENED  DISPLAY 


To  simplify  treatment,  the  design  method  is  described  for  a triple  integ- 
rator plant.  However,  the  method  applies  equally  to  other  kinds  of  plants. 


Controlled  Plant 


A triple  integrator  plant  can  be  represented  by  the  following  state  and 
output  equations. 


dt 


Ax  + Bra 
~p-p  -V 


(1) 


where 


X 


”P 


* denotes  the  time 
huraan  operator  and 
the  use  of  digital 
state  equation. 


y = Xpj  (2) 
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derivative,  m is  the  controlling  input  adjusted  by  the 
y is  the  plant  output.  Since  extended  quickening  assumes 
computers,  equation  (1)  is  approximated  by  the  discrete 


X (k+1)  - ;^(k)  + Bj-mCk)  (3) 

where  ^ ~V 
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At 

At  is  the  sampling  period  and  the  index  k denotes  k-th  sampling  Instance  or 
time  k*At.  The  sampling  period  is  selected  to  be  0.025  sec  which  is  short 
enough  to  maintain  small  approximation  error  and  yet  is  long  enough  for  most 
microcomputers  to  Inplement  extended  quickening. 
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Human  Operator 


For  deslm  purposes,  the  human  operator  is  first  approximated  by  a simple 
tine  delay,  e^  , where  the  delay  time,  L,  is  typically  0.1~0.2  sec.  With  a 
saapling  period  of  At,  the  discrete-time  model  is  a simple  delay  chain, 


where  d can  be  determined  from  (0.1-0. 2) /At.  In  the  following  development,  d 
is  selected  to  be  6 which  corresponds  to  0.15  sec  time  delay  with  the  selected 
At  of  0.025  sec.  The  input  to  the  human,  u(k) , is  the  displayed  signal  and 
the  output  of  the  htiman  is  the  plant  input,  m(k) . A state  space  model  for  the 
human  operator  is 


where 
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Xj^(kH)  = ^Xj^(k)  + Bj^u(k) 
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(4) 

(5) 


Equations  (3),  (4)  and  (5)  characterize  the  open  loop  human-plant  dynam- 

. Ics. 


Optimal  Control  Problem 

The  parameters,  a^'s  and  b^'s,  in  extended  quickening  can  be  found  from 
the  solution  of  an  optimal  control  problem  in  which  u(k)  must  be  determined 

so  as  to  minimize  the  cost  functional  given  by 

00 

•I  » I {(y(i)  - r(i))^  + w»(Au(i)/At)^}  (6) 

i-k 

where  Au(l)  ■ u(i)  - u(i-l)  (*Am(i+6)),  Au(l)/At  - du/dt,  r is  the  reference 
trajectory  and  w is  a positive  constant.  The  first  term  in  the  cost  fmctlo- 
nal  penalizes  the  tracking  error  and  the  second  term  penalizes  the  jerky  mo- 
tion of  the  displayed  signal. 

The  reference  trajectoty,  r,  is  assumed  to  be  prevlewable  (by  computer) 
in  the  sense  that  future  Information  which  Includes  the  8anq>led  values  (r(k), 
r(kfl) ,. . . ,r(k-f%Q) } is  avllable  at  time  k where  is  the  preview  (or  look 
ahead)  time.  is  zero  for  conventional  quickening.  Preview  information  is 

not  sufficient  for  finding  the  optimal  control,  u(k),  since  the  cost  function- 
al includes  r(i)  *s  from  i»k  to  1»«>.  Therefore,  it  is  further  assumed  that  the 
reference  trajectory  does  not  change  from  the  time  l«krftlj{,g:  l.e. 

r(fct-Nj,a+i+l)  ■ r(fcf%a+l)  for  all  i>0  (7) 
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Equation  (7)  applies  for  the  determination  of  u(k)  only.  For  determining 
u(k+l) , updated  preview  information  at  time  k+1  which  includes  the  sampled 
value  r(k+l-fNj2,^)  is  used,  and  the  lower  limit  of  the  summation  in  the  cost 
functional  becomes  k+1.  If  the  statistical  properties  of  the  reference  tra- 
jectory are  knovm,  they  can  be  used  in  place  of  equation  (7)  (references  6,7). 
Figure  5 shows  the  assumptions  made  about  the  reference  trajectory. 


Fig.  5 Information  on  Future  Reference  Trajectory  (at  time  k) 

Equations  (2) -(7)  define  an  optimal  control  problem  or  more  specifically 
a discrete  time  optimal  preview  control  problem.  This  problem  can  be  solved 
by  dynamic  programming  or  applying  the  results  of  linear  quadratic  (LQ)  opti- 
mal control  (reference  8) . 


Solution  of  the  Optimal  Control  Problem 


The  optimal  control,  u°^^(k),  is 


. -J^Spi«pi(k) 

where  gpj^'s,  g^i's  and  gj-^'s  are  all  constant  gains. 

The  feedback  gains,  and  gj^^'s,  are  given  by 

[Sl  *p2  «P3  *hl  - *h6]  ■ + p] 


where 


A'  B'  0 

-p  -p  - 


, R » w/(At)^,  P = [o  0 0 0 0 0 0 0 -r]  , 


K is  the  steady  state  solution  of  the  matrix  Riccati  equation, 

K(l)  - A\(i+1)A  + Q,  - [B^K(i+l)A  + p]^[R  + B^’^Kd+DB]"^  [^\(i+l) A + P] 

(K(“)  “2)  (10) 

and  Is  a 9X9  matrix  whose  1-1  element  is  1,  9-9  element  is  R and  all  other 
elements  are  0.  Since  A,  1^,  ^ and  P are  sparse,  the  Riccati  equation  can  be 
efficiently  solved  by  simple  recursions.  For  example,  it  can  be  easily  seen 
that  bJk  »(kgj^  k^2  ^93  ***  ^99]  ^ » k^^. 
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The  feedforward  or  preview  gains,  given  as  follows: 

For  0 (»o  preview) , 


For  N,  > 0, 
x-a 


*r0  " ®pl 


Sro  ■ Sm  -P'  s:‘£.  ‘ i i "u' 


\a-‘ 

- I 8 


rii. 


1 


(11) 


(12) 


where  Is  the  1-9  element  of  the  matrix 

^^losed^  » (A  - B[gpj  gp2  gp3  g|^j  ***  gjjg])  ♦ (13) 

laotlce  that  the  matrix  Closed  ch^J^^cterlzes  the  closed  loop  dynamics  of  the 
human-plant  model  plus  feedback  control  law,  and  Is  normally  asymptotically 
stable.  Equations  (12)  and  (13)  Indicate  that  the  future  values  of  the  ref- 
erence trajectory  must  be  used  In  a way  compatible  to  the  closed  loop  <fynamlcs 
and  that  gx>£*s  with  Increasing  i.  are  closely  related  to  the  unit  pulse  res- 
ponse of  the  closed  loop  system.  The  second  expression  In  (12)  Implies  that 
the  summation  of  gp£*s  with  respect  to  i must  be  equal  to  g . , which  assures 
zero  steady  state  error  for  the  step  reference  trajectory.  ^For  asymptotically 
stable  ^lotjod*  approaches  zero  as  i ^ncreases,  which  Implies  that  the 
future  Is  less  Important  to  determine  u°^  (k)  as  It  becomes  further  apart  from 
the  present  time.  This  point  has  also  been  found  In  pi^vlew  tracking  (re- 
ferences 3,  4,  5) 


Sturcture  of  Extended  Quickening 

The  structure  of  extended  quickening  based  on  the  optimal  control  result 


Fig,  6 Structure  of  Extended  Quickening  based  on  Optimal  Control 
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The  portion  of  the  structure  Inside  the  dashed  lines  can  be  viewed  as 
human  operator.  The  reason  for  this  will  soon  be  explained. 

For  selected  values  of  w over  a wide  range  (w  is  defined  in  the  cost  fun- 
ctional (6)),  the  steady  state  solution  of  the  Riccati  equation  (10)  was  com- 
puted and  the  feedback  gains,  g_£*s  and  found.  Results  are  sum- 

marized in  the  following  table." 


w 

®pl 

8p2 

®P3 

®hl 

®h2 

®h3 

®h4 

®h5 

®h6 

1.0 

0.0242 

0.0669 

0,0924 

0.0023  0.0022 

0.0022 

0.0022 

0.0021 

-0.9347 

0.1 

0.0757 

0.160 

0.168 

0.0042  0.0041  0.0040 

0.0039  0.0038 

-0.9129 

0,01 

0.236 

0.382 

0,309 

0.0076 

0.0074 

0.0072 

0.0069 

0.0067 

-0.884 

0.001 

0.730 

0.914 

0.573 

0.014 

0.013 

0.013 

0.012 

0.012 

-0.845 

0.0001 

2.255 

2.20 

1.076 

0.026 

0.025 

0.024 

0.022 

0.021 

-0.7935 

Table  1 


®pi 


*s  and 


^^*s  for  selected  values  of  w 


From  Table  1,  it  is  found  that  g^^j — g|^j  are  orders  of  magnitudes  smaller 
than  other  feedback  gains  and  that  the^ values  of  is  around  -(0. 8-0.9) 
regardless  of  the  value  of  w.  Hence  it  is  possible  to  approximate  the  portion 
inside  the  dashed  lines  in  figure  6 by 


1 


-6 


(0.8-0.9)z 


-1 


(14) 


With  our  selection  of  At*  0.025  sec,  the  discrete  transfer  function  (14)  cor- 


responds to 


K e 


-O.lSs 


V + 1 


N 


(0.125-0.25)  sec 


(15) 


where  the  time  constant,  t^j,  was  computed  by  - At/(l-»-  g^g)  • has  a 
reasonable  value  as  the  human  neromuscular  lag  constant  (reference  1),  which 
implies  that  the  feedback  effect  via  g.^  can  be  interpreted  as  a part  of  human 
dynamics.  Therefore,  the  portion  inside  the  dashed  lines  in  figure  6 can  be 
viewed  as  huu:an  operator,  and  the  feedback  gains  to  be  externally  furnished 
become  g g » and  g^„.  The  feedforward  and  preview  gains,  g n's,  must  also 
be  exterfially^’fumishia. 


Determination  of  Parameters  in  Extended  Quickening 

In  (extended)  quickening  (or  more  generally  in  manual  tracking),  the  gain 
constants  of  the  display  and  joystick  are  rather  arbitrarily  defined  since 
their  inputs  and  outputs  are  in  different  physical  domains.  It  is  also  known 
that  the  human  operator  adjusts  his  gain  so  that  the  closed  loop  dynamics  have 
reasonable  response  speed  and  adequate  stability  (reference  1).  Therefore, 
for  Implementation  of  (extended)  quickening  the  ratios  among  the  feedback  and 
feedforward  gains  (8_j^*s  and  g o’s)  are  more  Important  than  their  values  them- 
selves. Based  on  this  observaCion,  we  normalize  the  control  gains  with  res- 
pect to  g ..  The  normalized  gains  are  the  extended  quickening  parameters, 
a^’s  and  in  figure  4>  and  they  are 

^ - *•  “2  ■ *p2^*pl'  “3  ■ *p3\l-  “4  - 0 and  bj  . g^j/gp,.  (W) 


39 


Using  a^'s  and  b^'s  in  (16),  Che  signals  to  be  displayed  in  extended 
quickening  are,  for  pursuit  type  displays  „ 

3 xa 

8 (k)  - I a.x  .(k)  and  s (k)  - I b.r(k+£)  (17) 

P i-1  ^ P^  A-0  ^ 

and  for  compensatory  type  displays 

s(k)  - s^(k)  - Sp(k)  (18) 

where  s is  the  quickened  plant  output  and  Sr  is  Che  quickened  reference  tra'- 
jectory?  Final  tuning  of  the  parameters,  a^^'s  and  b^^^’s,  must  be  done  by  ex- 
periment . 


EXPERIMENT 


An  experiment  was  conducted  to  examine  the  effect  of  different  sets  of 
feedback  gains  in  Table  1 and  to  verify  performance  improvement  that  can  be 
achieved  by  extended  quickening.  In  the  experiment,  a triple  integrator  plant 
was  implemented  on  an  analog  computer.  An  LSI-11  microcomputer  was  used  for 
generating  the  reference  trajectory,  computing  the  extended  quickening  signals 
(s  and  s ) and  on-line  data  acquisition  of  experimental  data.  The  display 
wai  of  the  pursuit  type,  and  the  two  signals,  s and  s , were  displayed  by 
dots  each  with  different  Intensity.  Human  subjicts  were  asked  to  control  the 
plant  so  that  the  quickened  plant  output,  s , follow  the  quickened  reference 
signal,  s . Two  kinds  of  reference  trajectBrles  were  used  in  the  experiment. 
One  was  a^sequence  of  step  changes  with  a 20  sec  duration  for  each.  The  other 
was  a Gauss-Markov  random  signal  which  was  generated  by  a second  order  digital 
filter  excited  by  a Gaussian  white  signal.  The  digital  filter  was  an  approxi- 
mation of  the  continuous  second  order  filter  with  the  transfer  function 

G(s)  - -r ^ j (19) 

s + 2C0)  s + (*) 
n n 


where  u)  and  ^ were  selected  to  be  1.5  rad/sec  and  0,7.  Selectable  preview 
settlngS  were  provided  which  could  be  varied  from  ■ 0 (0  sec)  to  No  » 200 
(5  sec).  Evaluation  of  s (k)  with  200  was  not  feasible  in  a O.OSf  sec 
sampling  period  (cyclic  time  of  conputatlon) . However,  it  was  noted  that  the 
reference  trajectory  was  smooth  relative  to  a 0.025  sec  sanpllng  period  (the 
approximate  bandwidth  of  the  filter  (19)  is  1.5  rad/sec  ~ 0.25  Hz)  and  that  a 
good  approximation  to  s (k)  in  (17)  was 

8„(k)  ==  I b'r(fcfrp)  (20) 

p-0  P 


where  b* 
used  for 


■ f^i^^k)  precomputed,  and  (20)  was 
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Effect  of  Feedback  Gains 


The  first  set  of  experiment  was  conducted  to  examine  the  closed  loop  be~ 
havior  with  different  combinations  of  feedback  gains,  (i.e.  a^*s)  in 

Table  1.  In  the  e]q>erlment,  the  reference  trajectory  ^s  a series  of  step 
changes  and  was  zero,  i.e.  conventional  signal  quickening.  Time  histories 
of  the  plant  output  (y's)  for  different  values  of  w are  shown  in  figure  7.  It 
can  be  seen  in  the  figure  that  the  feedback  gains  obtained  with  the  larger  w 
make  the  closed  loop  relatively  slow  to  respond  while  those  obtained  with  the 
smaller  w make  the  closed  loop  oscillatory  and  require  more  controlling  effort 
of  the  human  operator.  It  was  concluded  that  the  feedback  gains  obtained  with 
w*0.01~0.1  were  most  suited  for  human  control  of  the  triple  integrator  plant. 


Fig.  7 Effect  of  Feedback  Gains  on  Closed  Loop  Behavior 


Extended  Quickening 

The  extended  quickening  experiment  was  first  conducted  with  the  step  ref* 
erence  trajectory.  The  parameters,  aj^*s  and  bj^*s,  were  selected  to  be  those 
computed  with  w~0.1.  This  choice  was  based  on  the  result  of  the  first  set  of 
experiment,  effect  of  feedback  gains,  described  above.  Time  histories  of  the 
plant  output  for  different  values  of  preview  time  (or  Nj^^)  are  shown  in  figure 

8.  ITie  inclusion  of  future  values  of 
the  reference  trajectory  In  the  dis- 
played signal,  8_,  causes  the  plant 
output  to  respond  prior  to  the  step 
reference  change.  The  maximum  and  RMS 
values  of  the  tracking  error  were  both 
Improved  by  previewing  the  reference 
trajectory.  A 4■^.5  second  preview  time 
160-200)  was  found  to  be  suffl- 
Fig.  8 Effect  of  Preview  TlmB(*  num-  cient  to  attain  almost  all  the  possi- 
bers  indicate  preview  times  in  sec)  performance  improvement  relative 
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Fig.  9 Effect  of  Preview  Time 
(random  reference  trajectory. 
Preview  Time»0.0255<Nj^^  sec) 


to  the  zero  preview  case  which  was  about 
SO  % reduction  of  the  maximum  error  (ob- 
served at  the  time  of  step  reference 
change)  and  about  70  % reduction  of  the 
BMS  error  computed  over  60  sec  (i.e.  3 
step  changes  of  the  reference  trajectory) . 
A similar  improvement  was  also  observed  in 
the  controlling  input.  Tlierefore,  the 
difference  among  the  four  response  curves 
In  figure  8 is  not  simply  a matter  of 
translation. 

The  extended  quickening  experiment 
was  also  conducted  with  the  random  refer- 
ence trajectory.  Figure  9 shows  the  plant 
output  for  different  values  of  It 

can  be  seen  In  the  figure  that  the  phase 
shifts  between  the  reference  trajectory 
and  the  plant  output  gradually  reduce  as 
Increases.  It  was  found  that  approx- 
imately a 2 second  preview  time 
was  sufficient  to  achieve  almost  all  the 
ioprovement  in  terms  of  the  BMS  tracking 
error,  approximately  50  % reduction  rela- 
tive to  the  zero  preview  case.  Further 
performance  lnprovement  beyond  was 

observed  primarily  in  the  controlling 
signal  whose  peak  and  BMS  values  were  both 
continuously  decreasing  as  was  In- 
creased from  80  to  200. 


CONCLUSIONS 


The  signal  quickening  technique  was 
extended  to  incorporate  the  future  refer- 
ence trajectory  variation  Into  the  dis- 
played signal  so  as  to  achieve  high  quail'* 
ty  tracking  in  manual  control  of  higher 
order  plants  with  little  or  no  damping. 

A design  method  for  extended  quickening 
systems  was  established  based  on  the  dis- 
crete time  optimal  control  theory.  The 
experiment  for  a triple  Integrator  plant 
Indicated  that  a drastic  improvement  of 
the  closed  loop  performance  can  be  obtain- 
ed by  extended  quickening. 

The  extended  quickening  technique 
should  be  useful  for  various  man-vehicle 
systems  Including  airplane  landing,  maneu- 
ver, submarine  control,  etc.  The  main 
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motivation  of  (extended)  quickening  was  to  facilitate  human  control  over  high 
order  plants  with  little  or  no  damping.  However,  for  the  cases  that  plants 
are  relatively  easy  to  control,  the  technique  should  be  still  useful  in  vari- 
ous respects,  e.g.  for  reducing  the  human  work  load. 

The  work  reported  in  this  paper  is  being  continued  to  Investigate  the  ex- 
tended quickening  technique  in  more  realistic  situations.  Enq>hasis  is  placed 
on  the  following  two  points: 

1.  State  Estimation:  It  was  assumed  that  the  derivatives  of  the  plant  out- 

put are  directly  measurable.  Although  the  assumption  holds  in  ideal  sit- 
uations such  as  the  triple  integrator  plant  on  an  analog  computer  in  this 
paper,  it  is  usually  not  possible  to  measure  all  derivatives  directly. 

In  such  cases,  one  possibility  is  to  Include  a Kalman  filter  or  state 
observer  in  conqputer  software. 

2.  Effect  of  Disturbance:  In  this  paper,  external  disturbance  Inputs  and/or 

noise  were  not  considered.  In  practical  situations,  disturbance  and 
noise  can  not  be  Ignored,  and  their  effect  must  be  investigated. 
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SUMMARY 


In  this  experimental  study  we  investigated  some  transient  phenomena  and 
target  acquisition  modes  associated  with  interrupted  observations  during 
ground-to-air  AA  tracking.  Our  subjects*  using  a two-axes  control  stick* 
tracked  a computer-generated  airplane  image  on  a CRT  display.  The  airplane 
image  executed  a low-level  straight  nass.  At  certain  pseudo-random  times 
during  each  25-second  run  the  screen  was  blanked  for  a period  of  one  second 
(simulating  a temporary  loss  of  visual  contact  with  the  target  due  to  clouds, 
fog  or  obstructions) . When  the  target  Image  reappeared  the  subjects  reac- 
quired it  and  continued  tracking,  attempting  to  minimize  vector  RMS  error  for 
the  entire  run  (including  the  blanked  period). 

The  results  reveal  an  increase  both  in  tracking  error  and  in  error  var- 
iance during  the  blanked  period,  only  when  the  target  disappears  while  in 
the  crossover  region.  Blanking  at  other  times  effected  increased  variance 
but  had  no  effect  on  the  mean  error.  Also,  blanking  before  and  after  cross- 
over had  opposite  effects:  A blanking  period  just  before  crossover  produced 

an  increase  lag  while  a blanking  just  after  crossover  resulted  in  a lead  and 
thus  made  the  error  curve  more  symmetric. 


INTRODUCTION 


The  problem  of  manual  tracking  performance  with  sampled  observations 
has  been  studied  before  (e.g..  Refs.  1,  2]  from  a “macroscopic"  point  of 
view.  In  these  studies  the  overall  control  performance  was  Investigated 
when  the  human  was  assumed  to  have  access  to  periodic,  frequent  observations 
of  the  system  outputs. 

In  the  study  reported  here  we  intedded  to  concentrate  on  the  micro- 
scopic aspects  of  the  tracking  behavior.  We  were  not  interested  in  the 
operator's  performance  as  a whole;  rather,  we  set  out  to  examine  the  details 
of  the  tracking  behavior  during  periods  when  observations  of  the  system  out- 
puts were  not  available  to  the  human.  Understanding  the  operator's  be- 
havior during  such  essentially  open-loop  tracking  is  of  interest  as  these 
situations  occur  quite  frequently  in  practice.  Examples  of  operators  sub- 
jected to  this  type  of  manual  tracking  may  be  the  driver  of  a high-speed 
automobile  during  the  first  few  seconds  after  entering  a dark  tunnel;  a 
radar  operator  attempting  to  track  a target  with  the  aid  of  noisy  position 
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data;  or  an  anti-aircraft  battery  operating  in  an  environment  of  electronic 
counter-measures ) optical  counter-measure  or  simple  topographical  and  mete- 
oreloglcal  obstructions  masking  the  target's  image.  Indeed,  our  experimental 
set-up  simulated  the  situation  of  the  latter,  l.e.,  the  AAA  paradigm. 


THE  EXPERIMENT 


Our  experimental  facility  consisted  of  a POP  11/20  computer,  a CRT 
screen,  and  a two-axes  control  stick.  The  POP  11/20  generated  a delta- 
shaped airplane  Image  used  in  the  compensatory  tracking,  with  the  Image 
displayed  on  the  CRT  screen  (see  Fig.  1). 

Our  subjlects  were  instructed  to  manually  track  the  delta-shaped  Image, 
both  in  elevation  and  in  azimuth,  as  it  passed  across  the  CRT  screen.  Each 
target  pass  was  a 25. 6-seconds  stralght-and-level  flyby.  At  predetermined 
times  during  the  run  the  target  disappeared  from  the  screen  for  a period 
of  one-second.  This  blanking  simulated  the  temporary  loss  of  visual  con- 
tact with  the  target.  Five  experimental  conditions  were  Implemented. 


Condition  A: 
Condition  D: 
Condition  E: 
Condition  F: 
Condition  G: 


No  blanking 

Blankings  at  -5  sec.  and  at  +9  sec.  (0,  sec.  • crossover) 
Blanking  at  -3  sec. 

Blanking  at  4-1  sec. 

Blanking  at  +3  sec.  and  at  +9  sec. 


The  purpose  of  two  blanking  periods  (Conditions  D and  G)  was  twofold:  In 

an  attempt  to  prevent  the  subjects  from  relaxing  their  tracking  effort  after 
the  first  blank  occured,  the  second  blanking  at  '1-9  seconds  was  introduced. 
Also,  this  eet  of  blanking  periods  enabled  us  to  compare  the  transient 
tracking  behavior  of  subjects  during  periods  of  good  tracking  (where  the 
target  angular  velocity  is  small  and  the  tracking  error  is  also  small)  with 
the  transient  phenomena  in  the  crossover  region.  Condition  A - no  blanking 
served  as  the  control  for  the  subjects'  baseline  tracking  ability. 

Six  University  of  Connecitcut  students,  members  of  the  University  Air 
Force  ROTC  program,  participated  in  thes  experiment.  They  were  trained  ex- 
tensively in  this  task  by  tracking  a variety  of  flybys;  however,  they  were 
not  exposed  to  blankings  until  the  formal  experimentation  conaaenced. 

Each  subject  was  presented  with  each  of  the  five  experimental  conditions 
in  randomized  order  and  there  were  7 replications,  for  a total  of  35  runt 
per  subject.  The  subjects  were  not  informed  as  to  the  number  of  blanking 
periods  in  each  run,  nor  were  they  told  how  many  experimental  conditions 
were  to  be  presented.  They  were  told,  however,  the  total  number  of  runs  to 
be  presented.  The  subjects  were  instructed  to  minimize  their  RMS  trsexing. 
error  Cor  the  entire  run.  Including  the  blanked  periods.  Following  each 
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run,  each  subject  was  informed  of  his  RMS  error  score  and  was  encouraged  to 
keep  it  as  low  as  possible* 

Tracking  errors  in  azimuth  and  elevation,  and  the  control  inputs  in 
these  axes  were  sampled  by  the  PDP-11/20  at  a rate  of  40  Hz*  Each  25*6- 
second  run  thus  yielded  1024  datum  points  for  each  of  these  four  dependent 
variables*  The  data  were  stored  in  real-time  or  secondary  devices  (discs 
and  magtapes)  for  subsequent,  off-line  processing  and  analysis. 


RESULTS  AND  DISCUSSION 


Some  results  of  this  experiment  are  presented  in  Figures  2-6*  Each 
figure  is  the  summary  azimuth  data  of  the  (6  subjects  x 7 replications  = ) 

42  runs  per  experimental  condition.  (In  the  interest  of  brevity,  elevation 
data,  which  are  completely  analogous,  were  omitted  here.)  Figures  2a  and 
2b  are  the  mean  and  standard  deviation,  respectively,  of  the  angular  track- 
ing error  under  the  baseline  condition.  Condition  A (no  blanking) * Figure 
2a  exhibits  the  asymmetry  (large  lag  just  before  crossover  and  smaller 
lead  immediately  after)  characteristic  of  this  tracking  task  [3].  Also,  the 
tracking  errors  are  quite  small  in  the  so-called  "areas  of  good  tracking" 
outside  the  crossover  region* 

Comparison  of  Figure  3 (standard  deviation.  Condition  D)  with  Figure 
2b  reveals  the  two  blanking  periods  which  manifest  themselves  as  spikes  in 
Fig.  3*  As  expected,  a blanking  period  just  before  crossover  produces  an 
Increased . lag  (Fig.  5),  while  a blanking  period  just  after  crossover  effects 
a lead  and  thus  makes  the  error  curve  more  s)nnmetrlc  (Fig.  6a) . 

These  deviations  from  the  baseline  error  curve  were  tested  using  a 
polnt-by-point  t-test  and  were  found  to  be  significant,  under  Condition  E 
and  F,  at  the  P < 0.01  level.  During  periods  of  good  tracking,  however, 
blanking  had  no  effect  on  the  tracking  error  mean.  This  was  true  not  only 
with  respect  to  the  blanking  period  at  +9  seconds  but  also  with  respect  to 
the  blankings  at  -5  seconds  and  at  ^3  seconds. 


CONCLUSIONS 


Increasing  the  operator's  uncertainty  of  the  target *s  position  for 
short  periods  Increases  the  lagging  tendency  before  crossover  and  the 
leading  tendency  - when  the  Instance  of  uncertainty  occurs  after  crossover. 
Uncerta'lnty  on  the  operator's  part  of  the  target's  motion  always  results 
in  increased  error  variance;  the  error  mean,  however,  is  sensitive  to  uncer- 
iainty  only  when  the  tracking  task  is  difficult.  In  periods  of  good  track- 
ing (and  hence,  small  tracking  error)  uncertainty  has  little  effect  on  the 
error  mean. 
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FIG.  2a:  Azimuth  Error  Mean,  No  Blanking 
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FIG.  2b;  Azimuth  Error  S.D.,  No  Blanking 


49 


Ill*  I t 

0 5 10  15  20  25  sec. 

FIG.  3:  Azimuth  Error  S.D.,  Blankings  (?  -5  & +9  sec 
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FIG.  4;  Azimuth  Error  S.D.,  Blankings  0 +3  & +9  sec. 
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FIG.  5;  Azimuth  Error  Mean,  Blanking  @ -3  sec. 
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FIG.  6a:  Azimuth  Error  Mean,  Blanking  @ +1  sec. 
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FIG.  6b;  Azimuth  Error  S.D.,  Blanking  @ +1  sec. 
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MODELING  THE  EFFECTS  OF  HIGH-G  STRESS  ON  PILOTS 
IN  A TRACKING  TASK 

by  Jonathan  Korn  and  David  L.  Klelnman 

Department  of  Electrical  Engineering  & Computer  Science 
University  of  Connecticut 
Storrs,  Conn.  06268 


SUMMARY 


Alr*>to~Air  tracking  experiments  have  been  conducted  at  the  Aerospace 
Medical  Research  Laboratories  (AMRL)  using  both  fixed  and  moving  base  (Dynam- 
ic Environment  Slmulator-DES)  simulators.  The  obtained  data,  which  includes 
longitudinal  error  of  a simulated  air-to-air  tracking  task  as  well  as  other 
auxiliary  variables,  was  analyzed  using  an  ensemble  averaging  method. 

In  conjunction  with  these  experiments,  the  Optimal  Control  Model  (OCM) 
is  applied  to  model  a human  operator  under  high-G  stress. 


INTRODUCTION 


Recent  efforts  at  Aerospace  Medical  Research  Laboratories,  WFAFB,  have 
demonstrated  initial  feasibilities  of  applying  the  Optimal  Control  Model  [1] 
of  human  response  to  the  air-to-air  tracking  problem.  The  model  has  been 
able  to  generate  predictions  of  ensemble  mean  and  standard  deviations  of 
longitudinal  tracking  error,  aircraft  stats  variables  and  attained  G forces 
corresponding  to  arbitrary  target  profiles.  The  preliminary  modeling  efforts 
were  focused  on  two  subproblems.  First,  effects  that  related  cost  functional 
weightings  and  Internal  model  parameter  changes  to  G-stress  were  considered. 
Second,  a structural  change  of  the  model  was  suggested.  The  data  for  this 
model  development  and  validation  has  been  generated  on  the  centrifuge  (DES) 
facility  at  AMRL.  The  most  recent  data  vs.  model  comparisons  have  shown  ex- 
cellent correspondance  for  tracking  error  ensemble  statistics.  Further  model 
refinement  efforts  are  now  under  investigation. 


ENGAGEMENT  SCENARIO 


Figure  1 shows  the  geometry  of  the  air-to-air  tracking  in  the  longitu- 
dinal plane  [2].  In  our  modeling  efforts  we  assumed  no  gunslght  dynamics, 
l.e.  the  sight  is  fixed  and  aligned  with  the  aircraft  body  axis.  An  addition- 
al simplification  has  been  added  by  assuming  that  pitch  angle  equals  the 
flight  path  angle.  -'i/ 
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FIG.  1;  TRACKING  GEOMETRY 

0^  ■ pursuer  fp  angle  0^  » evader  fp  angle 

Ij,  • inertial  line  of  sight 

sight 

t • ©T  " * ®®P®®*^  angle 

OPTIMAL  CONTROL  MODEL  FOR  AIR-TO-AIR  TRACKING 


The  OCMt  modified  to  treat  deterministic  target  motion  assumes  the 
system  dynamics 

x(t)  ■ A^  x(t)  + b^u(t)  + Fp  z(t)  (1) 

^(t)  - Cp  x(t)  (2) 

where  u(t)  ^ 5 is  the  elevator  deflection  and  z(t)  is  a function  of  the 
target  motion.^  The  state  vector  is 


'"t-  "a*  “a-  ®A  • ®T- 


where  is  the  target  (attacker)  pitch  rate,  a.  is  the  attacker  angle 

of  attack  and  e is  the  tracking  error.  The  observations  are 

- ie,  e.  r, 
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with  correspondance  to  the  OCM  assumtlon  on  observations, 
only  a delayed  and  noisy  signal 

2p(t)  - i(t-T)  + ^(t) 

where  v (t)  is  a white  observation  noise  with  covariance 


°i'> 


1*1, 


The  human  perceives 
(3) 

..,4  (4) 


T * operator  time  delay 

p*  ■ nominal  noise  to  signal  ratio 

y 

fj(t)  » fractional  attention  allocation  to  the  i-th  observed  variable 
N(a^)  * equivalent  gain  of  the  vlsual/lndifference  threshold  a^ 
y^  * mean  of  y^ 

0^  * standard  deviation  of  y^^ 

The  control  input  corresponds  to  the  differential  equation 

u<t)  - -L  I + 7”  V (t)  (5) 


where  L is  the  feedback  gains  vector,  k(t)  is  the  estimated  state,  Is  the 
neuro-mStor  time  constant  and  v (t)  is  a white  motor  noise  with  covariance 
proportional  to  the  covariance  of  u(t) 

V^(t)  « py  cov(u(t)J,  (6) 

being  the  motor  noise  ratio  coefficient.  The  system  matrices  are 
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0 0 0 0 1 

0 1 0 V/D  0 

0 0 0 -1  1 

1 0 0 V/D  0 


The  vertical  accelerations  of  the  target « and  those  commanded  by  the  attacker 
are  respectively 


G«(t)  - ^ • x,(t)  + 1 (7a) 

T g 1 

G^(t)  - I . X2<t)  + I (7b) 


The  constants  are 
- 11 

V » 1000  ft/sec  D - 1000  ft. 

2 

g ■ 32.2  ft/sec 
M ■ -7.63  sec  1 

q 

M « -20.66  sec  ^ 
a 

% * -2.27  sec  1 
0 

A typical  G_  time  history,  used  in  the  present  AMRL  studies  is  shown  in  Fig. 

2.  ^ 


TIHE 
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The  Internal  model  paranetera  were  set  to  their  nominal  values  t « .2  sec« 

p • >20  dB,  p * >14  dB«  t„  ■ .1  sec.  Usually,  the  nominal  value  of  p 
u y N y 

<*p**  } for  a single  observation  channel  would  be  >20  dB.  In  our  case  there 

are^4  observation  channels  which  Increase  the  nominal  p^  to  -14  dB. 

PILOT  MODEL  REVISION  AMD  RESULTS 


Motivated  by  recent  results  In  modeling  AAA  tracking  under  high  uncer> 
talnty  (3],  we  write  the  human’s  internal  characterisation  of  target  motion 
(Xj_  - as 


- -n(t)  Xj(t)  + z^(t) 

(8) 

rather  than 

Xj^(t) 

■ a(t). 

(9) 

Now, 

« z(t)  + o(t)  Xj^(t) 

fG^(t)  + a(t) 

G^(t)l 

(10) 

Using  this  approach  we  note  the  following  facts: 

1.  a(t)  does  not  affect  the  system  model. 

2.  a(t)  does  affect  the  Kalman  filter  submodel  equation  associated 
with  this  state, 

Xj^(t)  ■ -o(t)  Xj(t)  + C(t)  ; C(t)  - white  noise  (11) 

The  target  motion  is  perceived  by  the  human  operator  as  a Harkov  process  as 
opposed  to  a random  walk  (n«0).  It  reflects  the  pursuer's  uncertainty  in 
perceiving  the  target's  motion.  o(t)  is  chosen  according  to 

a<t)  + a(t)  • /r(C^)  • ^ (12) 


where 


/^(G^)  - 3 


(13) 


The  resulting  model>va>dsta  comparisons  for  ensemble  mean  error  (e(t))  for 
dynamic  and  static-G  cases  (G>stress  and  no  G>seress)  are  shown  in  Figures 
3-4,  respectively.  The  agreements  are  excellent  through  the  transient  G 
peak  to  recovery.  Nominal  parameters  have  been  used  for  the  basic  OCH  te> 
sponse  parameters;  the  only  change  between  static  and  dynamic  cases  is 

.53  static 

T,  - { (14) 

(.97  dynamic 
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a)  Experimental  Data 


FIG.  3;  MEAN  PITCH  TRACKING  ERROR,  1 PEAK,  G STRESS 
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a)  Experimental  Data 


b)  Model  Predictions 

FIG.  4;  MEAN  PITCH  TRACKING  ERROR,  1 PEAK,  STATIC  6 
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CONCLUDING  REMARKS 


A preliminary  modeling  work  in  the  area  of  air-to-air  tracking  task  has 
been  conducted  and  the  initial  results  have  been  extremely  encouraging.  How- 
ever, further  research  is  needed,  and  is  presently  continuing,  to  interpret 
these  results  and  to  match  the  standard  deviation  data. 

For  modeling  work,  a major  concern  is ^involved  with  the  OCM  internal 
parameters  and  their  dependence  on  Gg  and  G^  levels.  A set  of  new  exper- 
iments will  be  conducted  in  the  near  future  to  enhance  the  observations  of 
this  dependence. 

Also,  the  present  model  formulation  does  not  Include  any  motion-derived 
cues  as  G^  or  G2;.it  merely  regards  these  quantities  as  external  stressors, 
and  neglects  any  useful  motion  cues  that  they  may  provide.  It  is  the  feeling 
of  the  authors  that  this  aspect  of  modeling  work  need  to  be  considered  in  any 
future  modeling  efforts. 
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SUMMARY 


The  Luenberger  observer  theory  is  used  to  develop  a predictive  model 
of  a gunner *s  tracking  response  in  antiaircraft  artillery  (AAA)  systems. 
This  model  is  composed  of  an  observer,  a feedback  controller  and  a remnant 
element.  An  important  feature  of  the  model  is  that  the  structure  is 
simple,  hence  a computer  simulation  requires  only  a short  execution  time. 

A parameter  identification  program  based  on  the  least  squares  curve 
fitting  method  and  the  Gauss  Newton  gradient  algorithm  is  developed  to 
determine  the  parameter  values  of  the  gunner  model.  Thus,  a systematic 
procedure  exists  for  identifying  model  parameters  for  a given  antiaircraft 
tracking  task.  Model  predictions  of  tracking  errors  are  compared  with 
human  tracking  data  obtained  from  manned  AAA  simulation  experiments 
conducted  at  the  Aerospace  Medical  Research  Laboratory,  Wright-Patterson 
AFB,  Ohio.  Model  predictions  are  in  excellent  agreement  with  the 
empirical  data  for  several  flyby  and  maneuvering  target  trajectories. 


INTRODUCTION 


A systematic  study  of  threat  effectiveness  for  antiaircraft  ^rtillery 
(AAA)  systems  requires  the  development  of  a mathematical  model  for  the 
gunner *s  tracking  response.  The  gunner  model  is  then  incorporated  into 
computer  simulation  programs  as  shown  in  reference  1 for  predicting 
aircraft  attrition  with  respect  to  specific  antiaircraft  weapon  systems. 

Two  of  the  fundamental  design  requirements  of  a gunner  model  are  simplicity 
in  model  structure  and  accuracy  in  the  tracking  error  predictions.  A 
simple  gunner  model  structure  will  shorten  computer  simulation  execution 
time.  Obviously,  accurate  predictions  of  tracking  error  Implies  model 
fidelity  with  respect  to  describing  the  gunner's  tracking  performance. 

Then,  the  manned  threat  quantification  in  the  threat  analysis  will  be 
reliable. 
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An  antiaircraft  gunner  model  based  on  the  Luenberger  observer 
theory  in  references  2,  3 and  4,  is  developed  in  this  paper.  It 
satisfies  both  the  design  requirements  mentioned  above.  The  structure  of 
the  model  is  simple  and  its  predictions  of  tracking  errors  are  accurate. 

It  is  composed  of  three  main  parts  - an  observer,  a feedback  controller, 
and  a remnant  element.  An  observer  is  itself  a dynamic  system  whose  out- 
put can  be  used  as  an  estimate  of  the  state  of  a given  system.  The 
simplicity  of  the  observer  design  makes  the  observer  an  attractive  design 
method.  The  estimated  state  Is  then  used  to  Implement  a linear  state 
variable  feedback  controller  which  represents  the  gunner's  control 
function  in  the  compensatory  tracking  task.  The  effects  of  all  the 
randomness  sources  due  to  human  psychophysical  limitations  and  of 
modelling  errors  are  lumped  into  one  random  remnant  element  in  this  model 
design.  Another  Important  feature  of  this  model  is  that  its  parameters 
can  be  determined  systematically  Instead  of  by  trial-and-error.  A 
parameter  identification  program  based  on  the  least  squares  curve-fitting 
method  in  reference  5 and  the  Gauss-Newton  gradient  algorithm  in  reference 
6 is  developed  for  this  purpose.  This  program  Iteratively  adjusts  the 
parameter  values  to  minimize  the  least  squares  error  between  the  model 
prediction  of  tracking  error  and  actual  human  tracking  data  obtained  from 
manned  AAA  simulation  experiments  conducted  at  the  Aerospace  Medical 
Research  Laboratory,  WPAFB,  Ohio.  Thus,  it  provides  a convenient 
procedure  for  model  validation.  In  addition,  a computer  simulation 
program  is  developed  with  the  designed  model  describing  the  gunner's 
response  for  a given  AAA  tracking  task.  The  program  provides  time 
functions  of  the  ensemble  mean  and  standard  deviation  for  the  model’s 
tracking  error  predictions  (azimuth  and  elevation).  Computer  simulation 
results  are  in  excellent  agreement  with  the  empirical  data  for  several 
aircraft  fl>by  and  maneuvering  trajectories.  This  verifies  that  the  model 
can  predict  tracking  errors  accurately  and  thus  is  a reliable  description 
of  the  gunner's  compensatory  tracking  characteristics. 

A comparison  between  this  model  and  the  optimal  control  model 
in  references  7,  8 and  9 (by  Klelnman,  Baron,  Levlson)  is  also  given. 

It  can  be  shown  that  the  model  based  on  observer  theory  is  as  accurate  as 
the  optimal  control  model  in  predicting  tracking  errors.  In  addition, 
the  computer  execution  time  of  the  AAA  closed  loop  system  simulation 
utilizing  this  model  is  less  than  15%  of  that  using  the  optimal  control 
model.  This  is  a primary  advantage  of  a model  with  simple  structure. 


DESCRIPTION  OF  AN  AAA  GUN  SYSTEM 


The  tracking  task  of  an  antiaircraft  artillery  (AAA)  gun  system 
can  be  described  by  a closed  loop  (single  axis  tracking  loop)  block 
diagram  as  shown  in  figure  1.  Two  gunners,  one  each  for  azimuth  and 
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elevation  axes,  play  the  role  of  controller  in  this  man-machine  feedback 
control  system.  From  his  visual  display,  each  gunner  observes  the  tracking 
error,  ex  (one  for  azimuth  error  and  the  other  for  elevation  error),  whlcJs 
Is  the  difference  between  the  target  position  angle  6x  and  the  gunslght  line 
angle  6g.  Independently,  the  gunners  operated  the  hand  crank  to  control  the 
gunslght  system  In  order  to  align  the  gunslght  line  angle  (output)  with  the 
target  position  angle  (Input).  Therefore,  the  azimuth  tracking  task  Is  de- 
coupled from  the  elevation  tracking  task  In  this  AAA  system. 


TM(«C 


ricuM  li  auKx  ducmm  or  the  aaa  closed  loop  system 


The  purpose  of  this  paper  Is  to  develop  a mathematical  model  of  the 
response  characteristics  of  a gunner  In  a compensatory  tracking  task.  There- 
fore, In  the  following,  we  first  describe  the  mathematical  representation  of 
the  gunslght  and  rate-aided  control  dynamics  (the  gunslght  system)  and  the 
target  trajectories.  In  this  paper  the  transfer  function  of  the  gunslght 
system  considered  Is: 


0g(s)  1 

- — a 

U(s)  s 


(1) 


for  the  azimuth  angle  tracking  as  well  as  the  elevation  angle  tracking. 

(0g(s)  and  U(s)  are  the  Laplace  transforms  of  6g(t)  and  u(t)  respectively.) 

It  can  be  shown  that  this  transfer  function  Is  a valid  representation  of 
many  practical  gunslght  systems.  Several  flyby  and  maneuvering  trajectories 
In  reference  10  of  the  target  aircraft  of  45  seconds  duration  were  selected 
as  Input  to  the  AAA  system  of  figure  1.  These  trajectories  are  deterministic 
functions  of  time.  (But  their  dynamic  properties  §.j.,  0.j,,  etc.,  are  net  known 
precisely  to  trackers.  The  state  space  equation  of  the  gunslght  system  and 
the  target  motion  can  be  derived  as  follows. 

X - Ax  + Bu  + F6x 


where  x denotes  the  state  vector  having  two  components. 
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and  the  scalars  u and  6^  denote  the  control  from  the  AAA  gunner  and  the 

target  acceleration.  The  tracking  error  e«p  on  the  visual  display  is 
observed  by  the  gunner  and  is  expressed  in  the  measurement  equation: 

y ® Cx  (3) 

where  y is  the  observed  tracking  error  and  C is  a row  vector  [1  0]. 

Equations  (2)  and  (3)  will  be  used  in  the  next  section  to  develop  an 
AAA  gunner  model. 

AAA  GUNNER  MODEL 


This  section  presents  a mathematical  model  of  an  antiaircraft  gunner  in 
the  compensatory  tracking  task.  The  main  design  requirements  for 
developing  this  model  are: 

• accurate  model  prediction  of  tracking  errors 

• simple  model  structure 

• systematic  determination  of  model  parameters 

In  this  paper,  the  Luenberger  reduced  order  observer  theory  has  been 
applied  to  design  the  gunner  model  which  satisfies  the  above  design 
requirements.  Figure  2 shows  the  block  diagram  of  this  model  consisting 
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AAA  emma  model 


ncini  2i  ILOCE  DUCMN  OF  IMI  SIWCIVU  OF  THE  AM  CUNNOt  MODEL 


of  three  main  elements:  observer,  controller,  and  remnant.  The  first 

element  is  a reduced-order  observer  which  processes  the  gunner's 
observation  from  the  visual  display  to  provide  an  estimate  of  the  states 
of  the  AAA  system.  It  will  be  shown  that  the  system  equation  (2)  is  a 
2nd  order  system,  but  the  reduced-order  observer  is  only  of  the  first 
order.  Since  some  components  of  the  state  as  given  by  the  system  outputs 
are  already  available  by  direct  measurement.  The  estimation  of  these 
components  of  the  state  is  not  necessary  and  will  cause  a certain  degree 
of  redundancy.  The  use  of  a reduced-order  observer  eliminates  this 
redundancy  and  still  provides  sufficient  Information  to  reconstruct  (or 
estimate)  the  state  of  the  observed  system.  The  controller  represents 
the  gunner's  tracking  function  by  an  estimated-state  linear  feedback 
control  law.  The  observer  and  the  controller  consists  of  the  deterministic 
part  of  the  gunner  model.  The  effects  of  the  various  randomness  sources 
in  the  AAA  man-machine  closed  loop  system  and  of  the  modelling  errors 
are  lumped  into  one  element  called  remnant  which  is  the  stochastic  part 
of  the  gunner  model.  These  randomness  sources  Include  the  modelling  error, 
the  observation  error,  the  neuromotor  noise,  etc.  Mathematical  equations 
of  this  model  are  given  below. 


Model  Equations 

System  equations  (2)  and  (3)  are  used  in  the  design  of  the  gunner 
model.  However,  the  gunner  doesn't  have  the  precise  information  about  the 
target  dynamics,  so  the  term  representing  target  acceleration,  6f,  in 
Eq.  (2)  will  not  be  included  in  the  design  of  the  observer  equation. 

The  effect  on  the  tracking  error  due  to  the  modelling  error  of  the  gunner's 
uncertainty  about  target  dynamics  will  be  included  in  the  remnant  element. 
Now  from  Eq.  (3), 

y = Cx  ■ xj 

the  tracking  error  is  available  from  direct  observation.  Thus,  it  is  only 
necessary  to  estimate  the  second  component  X2  of  the  state  vector  x in 

order  to  implement  a state  variable  feedback  control  law.  By  the 
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reduced-order  Luenberger  observer  theory  in  reference  4,  an  estimate 
of  the  state  variable  X2  can  be  obtained  by 

*2  “ X2  + + (^2^  - kaj^j^)  y + (b2  - kb^^)  ^ 

where  a^^  and  b^^  are  the  elements  of  matrices  A and  B in  Eq.  (2),  the 

scalar  k is  the  observer  gain,  y and  ^ are  the  observed  tracking  error  and 
error  rate  respectively,  and  is  the  linear  feedback  control  law  (the 
controller)  with  the  form: 


-tYl  Yjl 


where  the  feedback  control  gains  and  Y2  constants  deter- 

mined in  reference  10.  Note  that  the  state  feedback  is  composed  of  y 
(the  observed  variable  which  is  x.)  and  $2  (the  estimated  state  of  X2  ). 
It  can  be  shown  that  the  system  (2)  and  (3)  is  completely  observable. 
(The  definition  of  observability  and  the  conditions  of  a system  to  be 
observable  can  be  found  in  reference  11).  Then,  by  the  observer  theory, 
there  always  exists  an  observer  gain  k to  make  the  eigenvalue  of  the 
observer  (Eq.  (4))  negative.  Thus,  the  output  of  the  observer  will  be  a 
good  estimation  to  the  state  of  the  observed  system.  This  shows  the 
existence  of  proper  observer  gain  k in  Eq.  (4).  Actually,  the  value  of 
observer  gain  k is  determined  by  a curve-fitting  identification  program. 
The  required  differentiation  of  y in  Equation  (4)  can  be  avoided  by 
introducing  the  following  variable: 


z(t)  - X2  -ky(t) 


(5) 


Hence  the  observer  dynamics  can  be  represented  by 


4 * (^22  ■ ^®22  " ^®21  ” ^^2  “*^^l^“c 

Next,  the  actual  output  of  this  model  is  expressed  as  the  sum  of  the 
output  u^  of  the  controller  and  the  remnant  element  v. 


u ■ u + V 
c 


(7) 


where  the  remnant  term  v(t)  is  modeled  as  a white  noise  and  its  statistical 
properties  are  selected  to  be 


E tv(t)J  - 0 
E (v(t)  v(x)  ] 
E is  the  expectation  operator. 


for  all  t 

* q(t)  6(t  - t)  for  all  t and  T where 
5(t)  is  the  Dirac  delta  function  and  the 


(8) 
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covariance  function  q(t)  is  assumed  as  a function  of  estimated  target 
dynamics, 

A 

q(t)-  (t) 


(9) 


^here  a^, 

9^  and  are 


and  are  three  nonnegative  constants  to  be  determined,  and 
estimated  target  angle  rate  and  acceleration  respectively. 


Equations  of  the  Closed-loop  AAA  System 


In  the  previous  section,  the  gunner  model  equations  of  the  observer, 
the  controller,  and  the  remnant  have  been  derived.  These  equations  are 
combined  with  system  equations  (2)  and  (3)  to  obtain  the  mathemtlcal 
model  of  the  closed  loop  AAA  system.  Since  * y,  Eqs.  (2)  and  (6)  can 

be  rewritten  as  follows: 


y « a^j^y  + *2  "*■  ^l“  ^1®T 

*2  ■ “21>'  *22*2  * >’2“  * '2®  T 

2 * ^^22  ^^12^^  ^^22  **  ^ ^^21 


(10) 

. (bj  - kbj) 


u » u 4*  V 
c 

"c‘-'l'll'2>  [*2] 

By  introducing  new  variables: 
x^  • X2  - ky 
and 

e » Xj  - 2 

Eq.  (10)  can  be  rewritten  as 
X - A^x  + + Dj^v 

where  X is  the  state  vector  of  the  overall  system  with  components: 


” • 

m m 

y 

y 

X - 

*3 

m 

«2  - ky 

e 

Xj  - 3 

(11) 

(12) 
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anti  and  are  matrices  defined  as  follows: 


Kl  ^12*^  “ ^2^  ®12  ” ^*1  ^2 


^^22*"^^12  ^^"^^21*"  ^^11 
-(b2-kb^)  (Yi+kY2) 


0 


f2  - kf^ 

fj  - ktj 


"1^2 


®22  “ *'®12 


'*2  " *^^1 
b2  - kb, 


Once  the  structure  of  the  model  is  designed,  the  next  step  is  to  determine 
the  parameters  associated  with  this  model  (i.e.  k,  Y,»  Y2»  “2’  ^3 

in  Eqs.  <6),  (7)  and  (9)).  It  is  Important  to  have  a systematic  method 
to  determine  these  parameters  for  a given  AAA  system.  A parameter 
identification  program  based  on  the  least  squares  curve-fitting  method 
and  the  Gauss  Newton  gradient  algorithm  has  been  developed  by  the  authors. 
This  program  can  easily  determine  the  parameters  of  the  gunner  model  by 
minimizing  the  difference  between  the  model  prediction  of  the  tracking 
error  and  the  corresponding  empirical  data.  The  following  equations 
(mean  equation  and  covariance  equation)  are  used^in  the  curve-fitting 

program.  Letting  the  expectation  value  of  X be  X,  Chen  we  have, 

• 

X - A.X  + F,0,  (13) 

X IT 


and  the  covariance  matrix  of  X (t)  is  P(t)  • E(  <X(t)  - X(t))(X(t)-X(t))  ]; 
Chen  it  can  be  shown  in  reference  11  that  the  covariance  matrix  is  governed 
by  • M m 

P • A,P  + PA,  +0,  q(t)  D,  ^ (1^) 


Equations  (13)  and  (14)  are  used  in  the  parameter  identification  program 
to  fit  the  empirical  data  obtained  from  the  manned  AAA  simulation 
experiments  conducted  at  the  Aerospace  Medical  Research  Laboratory, 
Wright-PatCerson  AFB,  Ohio.  The  detail  of  the  Identification  program  and 
the  curve-fitting  procedure  can  be  found  in  reference  10.  The  results 
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of  curve-fitting  parameter  identification  program  are  shown  in  the  following 
table: 


k 

^2 

«1 

^2 

*^3 

Azimuth 

Tracking 

2.9A 

-2.87 

-1.00 

.0496 

.0024 

.103 

Elevation 

Tracking 

3.02 

-3.01 

-1.00 

.0032 

.00047 

.259 

SIMULATION  RESULTS  AND  DISCUSSION 


The  numerical  values  of  the  parameters  of  this  gunner  model  were 
determined  in  the  previous  section  with  respect  to  the  gunsight  dynamic 
system  (Eq.  (2))  and  a specific  target  trajectory.  The  gunner  model  is 
now  ready  to  be  used  for  computer  simulation.  A computer  simulation 
program  of  the  AAA  system  with  this  model  representing  the  gunner  response 
was  developed.  The  input  to  this  program  is  the  target  motion  trajectory. 
The  outputs  are  the  model  predictions  of  the  ensemble  mean  and  standard 
deviation  of  the  tracking  error.  A typical  result  Is  plotted  in  fig.  3 
for  a specific  target  trajectory.  The  solid  line  in  fig.  3 denotes  the 
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empirical  data  of  the  sample  ensemble  mean  for  azimuth  tracking  errors* 

The  corresponding  model  prediction  is  denoted  by  the  dotted  line  in  fig  3. 
There  is  an  excellent  match  between  these  two  curves.  Similar  comparison 
between  model  predictions  and  empirical  data  for  several  other  flyby  and 
maneuvering  target  trajectories  can  be  found  In  reference  10.  All  the 
simulation  results  show  that  this  gunner  model  with  the  same  parameter 
values  can  predict  accurately  the  tracking  errors  for  various  target 
trajectories  with  similar  frequency  band  widths.  Therefore,  it  is  a 
predictive  model.  The  values  of  the  model  paremeters  depends  on  the  gun- 
sight  dynamic  system.  Furthermore,  this  model  is  adaptive  with  respect  to 
the  target  motion  and  this  adaptive  property  is  considered  in  the 
structure  of  the  covariance  function  (Eq.  (9))  of  the  remnant  element. 

A comparison  of  the  model  prediction  accuracy  between  this  model 
and  the  optimal  control  model  in  reference  7 has  been  done  for  several 
target  trajectories.  All  the  results  show  chat  both  models  give  accurate 
predictions  of  tracking  errors.  A typical  result  is  shown  in  fig.  4 
for  a flyby  trajectory.  It  is  obvious  Chat  the  gunner  model  developed  in 
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this  paper  can  predict  the  tracking  errors  as  accurately  as  those  obtained 
by  the  optimal  control  model.  However  the  computer  execution  time  of 
simulating  the  AAA  gun  system  using  the  gunner  model  is  less  than  15% 
of  that  by  the  optical  control  model.  It  is  a primary  advantage  of  a 
model  with  simple  structure.  It  can  be  concluded  that  the  gunner  model 
based  on  observer  theory  is  very  useful  in  the  analysis  of  the  performance 
of  the  AAA  gun  system. 


CONCLUSION 


The  Lucnberger  observer  theory  has  been  applied  to  design  an 
antiaircraft  gunner  model  which  is  composed  of  a reduced-order  observer, 
a state  variable  feedback  controller  and  a remnant  element.  The  hl,;h- 
lights  of  this  model  are  simple  in  the  structure  and  accurate  In  the 
model  prediction  of  tracking  errors.  The  key  dislj'.n  requirement  is  to 
make  the  model  structure  simple  so  that  it  can  shorten  computer  simulation 
time.  It  has  also  been  shown  in  figures  3 and  4 chat  this  model  can 
predict  the  tracking  errors  accurately.  In  addition,  a parameter 
identification  program  based  on  Che  least  squares  curve-fitting  method  and 
Che  Gauss  Newton  algorithm  has  been  used  to  systematically  determine  the 
numerical  values  of  the  model  parameters*  This  gunner  model  has  been 
used  to  study  Che  AAA  effectiveness  of  several  air  defense  weapon  systems 
at  the  Aerospace  Medical  Research  Laboratory,  Wright-Patterson  AFB. 

All  the  results  show  that  it  is  an  ac  jrate  and  efficient  antiaircraft 
gunner  model. 
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SUMMARY 


Modeling  the  human  as  a controller  of  slowly  responding  systems 
with  preview  is  considered.  Along  with  control  tasks,  discrete  non-control 
tasks  occur  at  irregular  intervals.  In  multitask  situations  such  as  these, 
it  has  been  observed  that  humans  tend  to  apply  piecewise  constant  controls. 
It  is  believed  that  the  magnitude  of  controls  and  the  duraticms  for  which 
they  remain  constant  are  dependent  directly  on  the  system  bandwidth,  preview 
distance,  complexity  of  the  trajectory  to  be  followed,  and  nature  of  the 
non -control  tasks.  A simple  heuristic  model  of  human  control  behavior  in 
this  situation  is  presented.  The  results  of  a simulaticxi  study,  whose 
purpose  was  determination  of  the  sensitivity  of  ttie  model  to  its  parameters, 
are  discussed. 


INTRODUCTION 

Although  successful  operation  of  an  airliner  is  now  possible  from 
take-off  to  touchdown  with  minimum  involvement  of  the  human  pilot  [t]  he 
must  still  perform  various  routine  checks  in  the  course  of  a normal  flight. 
In  addition,  even  when  flying  on  autopilot,  constant  monitoring  of  various 
Instruments  is  necessary  to  detect  any  out  of  tolerance  signals  and  abnormal 
occurences  of  any  events.  Further,  malfunctions  or  changes  in  atmospheric 
conditions,  for  example,  might  require  that  the  pilot  take  over  control  and 
make  course  changes  that  are  different  from  the  preplanned  trajectory.  Thus, 
despite  advances  in  automation,  human  control  of  aircraft  is  certainly  still 
of  interest . 


When  the  human  is  controlling  a plant,  it  has  been  observed  that 
the  controls  applied  are  not  always  continuous.  Continuous  controls  are 
necessary  and  are  observed  when  the  time  constants  involved  are  rather  small 
and  the  deviations  from  some  reference  trajectory  must  be  kept  within  some 
close  tolerance.  But  when  the  time  constants  are  relatively  large,  it  is 
unnecessary  and  also  difficult  to  apply  the  right  amount  of  continuous 
control.  For  slowly  responding  processes  it  is  often  sufficient  and 
desirable  to  apply  step-like  controls  intermittently.  This  gives  an 
opportunity  to  observe  the  actual  behavior  of  the  system,  compare  it  with  the 

* This  research  was  supported  by  the  National  Aeronautics  and  Space 
Administration  under  NASA-Ames  Grant  NSG-2119> 
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predicted  behavior,  and  take  corrective  action.  This  usually  prevails  in  a 
tracking  situation  where  a certain  length  of  the  future  command  trajectory  is 
available,  along  with  the  present  required  position.  Further,  applying  the 
step-like  controls  also  frees  the  human  to  engage  in  non-control  tasks.  In 
fact,  this  kind  of  behavior  is  common  in  process  control  situations  and  also 
has  been  observed  in  simulations  of  a flight  management  situation  [2],  [3]. 

When  preview  of  the  command  trajectory  for  a certain  distance 
into  the  future  is  available,  it  is  likely  that  the  human  would  apply 
step-like  controls  so  as  to  minimize  the  future  trajectory  deviations  rather 
than  instantaneous  deviati<xis.  A model  which  appears  reasonable  is  one  which 
updates  the  expected  deviations  of  the  cost  over  the  length  of  the  previewed 
trajectory  and  uses  this  information  along  with  the  knowledge  that  it  ''costs'* 
to  change  control  values.  The  cost  to  change  control  reflects  the  fact  that 
non-control  tasks  must  be  attended  to,  thou^  they  may  not  be  of  primary 
importance.  The  "cost"  is  thus  due  to  the  feeling  that  the  lun-control  tasks 
would  •suffer"  if  attention  is  focused  away  from  them  and  on  the  primary  task 
alone.  This  cost  may  manifest  itself  as  a tolerance  threshold  for  error 
below  which  no  action  is  taken.  A measure  for  the  cost  of  not  attending  to 
the  subsystem  tasks  is  available  as  a function  of  various  probabilities  and 
costs  for  delay  of  subsystem  tasks  [M] . 


BACKGHOOMD 

Of  the  available  models  for  manual  control,  the  optimal  control 
model  would  appear  to  be  a suitable  candidate.  However,  this  model  assumes 
that  control  remains  non-zero  at  all  times  whereas  in  an  intermittent  control 
situation,  control  is  zero  for  a significant  portion  of  the  time.  Hence  the 
mean  fraction  of  time  devoted  solely  to  control,  corresponding  to  non-zero 
control  intervals,  cannot  be  calculated  with  the  optimal  control  model.  For 
a given  fraction  of  attention,  the  conventional  optimal  control  model 
predicts  only  HhS  errors  and  RMS  control  actions.  While  recent  versions  of 
the  model  do  yield  a measure  of  attention  that  should  optimally  be  used  for 
monitoring  subsystems  that  dynamically  relate  to  the  control  task,  subsystem 
t?.sks  that  only  remotely  relate  to  the  aircraft's  dynamic  response  cannot  be 
considered.  Further,  in  multitask  situations  the  optimal  control  model's 
performance  criterion,  which  minimizes  mean  squared  deviations,  may  not  be 
appropriate.  Finally,  these  approaches  do  not  yield  any  predictions  of  the 
split  of  attention  between  control  and  non-control  tasks  or  about  the 
probability  that  the  human  is  involved  in  the  control  of  a continuous  system 
at  any  particular  instant. 

The  human  in  multitask  situations  has  been  modeled  by  Walden  and 
Rouse  [3]  as  a ’server'  in  a queue  where  'customers'  are  the  control  and 
non-control  tasks.  The  customers  are  assumed  to  arrive  for  service  with 
exponentially  distributed  inter-arrival  times  (Poisson  arrivals. ) Service 
times  are  Hrlang-k  distributed.  Some  customers  have  a higher  priority  over 
others  (e.g.»  control  tasks  over  non-control  tasks.)  There  are  a total  of  N 
customers  in  the  population  (total  number  of  possible  tasks  the  human  may  be 
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called  upon  to  attend),  and  N spaces  are  available  in  the  queue  (l.e.*  at 
worst  all  the  h systems  may  require  service  simultaneously. ) This  situation 
can  be  modeled  as  a (M/Ej^/I  :PBP/N/h)  queue.  (See  references  [5]  or  [6]  for 
details  about  the  notation. ) The  queueing  model  predicts  the  fraction  of  time 
spent  in  each  type  of  task  (i.e.,  server  utilization).  The  emphasis  in  this 
model  is  on  the  subsystem  task  performance.  The  control  task  is  modeled  in 
the  sense  that  performing  it  consumes  time.  However,  measures  characterizing 
control  performance  (i.e.,  RMS  errors)  are  not  available. 


AN  INITIAL  MODEL 

Some  success  has  been  achieved  using  a heuristic  model  to 
describe  control  of  an  aircraft  (with  simplified  dynamics)  in  a horizontal 
plane.  Initial  computer  simulations  indicate  that  this  could  be  a fruitful 
approach.  A piece-wise  straight  line  map  was  created  using  uniformly 
distributed  random  variables  for  the  length  of  straight  line  segments.  The 
magnitudes  for  angle  of  turn  between  segments  were  chosen  from  nine  values 
(10*-90*)  with  equal  probability.  The  direction  was  chosen  randomly.  This 
type  of  map  was  designed  because  of  the  flexibility  in  determining  the 
parameters.  It  is  a simple  matter  to  change  the  probability  distributions  of 
various  parameters  of  the  path,  so  that  different  conditions  could  be  easily 
tested.  It  was  assumed  that  the  aircraft  would  be  moving  forward  with 
constant  speed.  A point  moved  along  the  map  corresponding  to  the  desired 
aircraft  position.  A distance  equivalent  to  two  time  constants  ahead  of  the 
desired  position  on  the  map  was  shown  as  preview.  Only  lateral  motion  was 
considered.  Control  in  the  horizontal  plane  was  achieved  through  use  of  the 
aileron  to  diange  the  bank  angle.  The  dynamics  are  shown  in  Figure  1. 
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The  deviaticsi  from  the  desired  positiai  was  constantly  monitored. 
A perfect  internal  model  of  the  aircraft  was  assumed.  At  every  time  instant, 
the  model  calculated  the  future  positions  for  the  entire  preview  length 
assuming  that  the  roll  angle  would  be  zero.  At  any  point,  the  error  was 
calculated  as  the  deviation  from  the  commanded  position,  instead  of  the 
perpendicular  distance  to  the  map 

It  appears  reasonable  to  expect  that  the  importance  given  by  the 
human  operator  to  deviaticms  from  the  desired  trajectory  will  vary  along  the 
length  of  the  trajectory.  Deviations  at  the  current  time  cannot  be  corrected 
or  changed  significantly  due  to  the  slow  response  of  the  system.  Also,  the 
expected  deviatiais  near  the  end  ot  the  previewed  command  trajectory  need  not 
be  considered  immediately,  since  enough  time  will  be  available  in  the  future 
to  correct  these.  Further,- any  changes  "beyond  the  horizon"  that  would  come 
into  view  soon  can  reasonably  be  ignored.  Accordingly,  the  human  might 
weight  the  mid -portion  of  the  previewed  command  more  than  either  end.  So 
the  weighting  function  for  errors  would  increase  to  a maximum  (from  zero)* 
about  one  time  constant  from  the  current  position*  and  decrease  again  to  a 
near  zero  value  at  the  end  of  the  trajectory. 


TmuieeToiixzs  i nmoKZ  hooel 

Fig.  2 Simulctlon  Rwulta  : Heuristic  Model 


Imeighted  error  is  squared  and  summed  over  the  preview  length.  If 
this  predicted  error  function  exceeds  a certain  threshold,  ’aileron*  is  held 
at  a maximum  value  until  maximum  bank  angle  is  reached.  If  the  error  is 
within  the  threshold,  the  bank  angle  is  made  zero.  Constant  weights  on 
errors  were  uped  for  the  simulation.  The  results  are  .shown  in  Figures  2 and 
3 and  appear  reasonable.  The  time  intervals  corresponding  to  non-zero 
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aileron  action  give  a direct  measure  of  fraction  of  time  required  for  control 
which  is  proposed  as  a correlate  of  workload.  Although  the  human  must 
continuously  monitor  for  cumulative  error,  workload  due  to  this  is  assumed 
negligible  compared  to  the  workload  involved  in  control  where  he  must  watch 
the  effect  of  his  actions  more  carefully. 


Fig.3  Control  and  Roll  Angle  History  for  a Given  Course  Change 


Simulation  experiments  were  conducted  usii.,;  ^ fractional 
factorial  design  to  find  out  the  sensitive/relevant  parameters.  A resolution 
VI  design  was  used  so  that  no  main  effect  or  two  factor  interaction  is 
coifounded  with  any  other  main  effect,  two  factor  interaction,  or  three 
factor  Interactions.  The  following  parameters  were  assumed  to  affect 
performance: 


1.  Dynamics  ( t of  the  process), 

<:  Average  arrival  rate  of  turns, 

3 Standard  deviation 
of  course  changes 

4.  Amount  of  preview 

5.  Weighting  function, 

6 Ihreshold  on  cumulative 
weighted  error. 
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R4S  errors  and  the  fraction  of  time  spent  on  control  were  used  as  performance 
measures.  A constant  function  (rectangular)  and  a triangular  function  were 
used  for  weighting  on  errors.  For  other  parameters,  two  extreme  values  were 
chosen,  to  obtain  a total  of  32  different  conditions.  Exponentially 
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distributed  segment  lengths  and  normally  distributed  angles  of  turn  were  used 
for  the  map.  For  each  condition,  two  replications  were  run.  The  results  are 
snown  in  Tables  1 and  II. 


Table  I 


Analysis  for  RMS  Error 


factor 

Effect 

Sum  of 
Squares 

DOF 

F Ratio 

1 

4*433 

314.409 

1 

131.037 

P 

< 

0.001 

2 

-0.671 

7-206 

1 

3.003 

3 

1.477 

34.887 

1 

14.540 

P 

< 

0.001 

4 

4-087 

267-247 

1 

111.381 

P 

< 

0 001 

5 

-1.397 

31.219 

1 

13.011 

P 

< 

0.001 

6 

0.622 

6.188 

1 

2*579 

12 

-0 .268 

1.145 

1 

0.477 

13 

1 .108 

19.653 

1 

8-191 

P 

< 

0.01 

14 

4.174 

278 .726 

1 

116.165 

P 

< 

0.001 

15 

-0.886 

12.557 

1 

5.233 

P 

< 

0-05 

16 

-0.250 

1.004 

1 

0.418 

23 

-0.288 

1-325 

1 

0.552 

24 

0.049 

0.038 

1 

0.016 

25 

0.335 

1.794 

1 

0.748 

26 

1.315 

27.676 

1 

11.535 

P 

< 

0.005 

34 

0.383 

2.350 

1 

0.979 

35 

1.295 

26.822 

1 

11.179 

P 

< 

0.005 

36 

0.197 

0.619 

1 

0.258 

45 

-0.914 

13-364 

1 

5.570 

P 

< 

cr.025 

46 

0.258 

1.062 

1 

0.443 

56 

0.124 

0.246 

1 

0.102 

Average 

4 .192 

Error 

100.774 

42 

Total 

1150.313 

63 

(1-Period • 2-Segment  Length*  3-Angle  of  Turn, 
il-Preview  Length*  5-Weight,  6-Threshold) 


80 


Table  II 


Analysis  for  Fraction  of  Attention 


Factor  Effect  Sum  of  DOF  F Ratio 
Squares 


1 

0-231 

0.856 

1 

33-221 

P 

< 

0.001 

2 

-0.057 

0-051 

1 

1.999 

3 

0.017 

0.005 

1 

0.181 

4 

0.144 

0.331 

1 

12.837 

P 

< 

0.001 

5 

-0. 1 17 

0.218 

1 

8.468 

P 

< 

0.01 

6 

-0.139 

0-311 

1 

12.084 

P 

< 

0.005 

12 

0-004 

0.000 

1 

0.011 

13 

-0.018 

0.005 

1 

0.206 

14 

0.269 

1.158 

1 

44.963 

P 

< 

0.001 

15 

0.000 

0-000 

1 

0.000 

16 

0.004 

0.000 

1 

0.008 

23 

0.067 

0.072 

1 

2.783 

24 

0.030 

0.014 

1 

0-541 

25 

0 005 

0*000 

1 

0.017 

26 

0-060 

0.058 

1 

2-234 

34 

-0.074 

0-087 

1 

3-359 

35 

0.047 

0.035 

1 

1.374 

36 

-0.043 

0.030 

1 

1.155 

45 

0.005 

0 000 

1 

0-014 

46 

0.048 

0.037 

1 

1-435 

56 

0.090 

0.129 

1 

5.011 

P 

< 

in 

0 

0 

Average 

0-256 

Error 

1.082 

42 

Total 

4-479 

63 

( 1-Period » 2-Segment  Length*  3-Angle  of  Turn, 
i|-Preview  Length  5-weight,  6-Threahold) 


It  can  be  seen  that  period,  preview  length  and  their  Interaction 
have  the  largest  effect  on  perforroence.  Different  weighting  functions  also 
affejt  performance*  In  addition,  RMS  error  is  affected  by  the  magnitude  of 
turns  and  various  interactions*  Fraction  of  time  spent  on  control  is 
affected  by  the  threshold*  Higher  threshold  values  reduce  this  fraction. 

Though  the  interaction  of  mean  segment  length  and  threshold 
affects  the  hHS  error,  segment  length  alone  does  not  affect  either  of  the 
performance  measures.  This  could  be  due  to  the  constant  forward  speed  in  all 
cases,  whereas  the  mean  segment  length  is  scaled  by  the  time  constant.  For 
slower  process,  for  a given  threshold  any  error  that  may  result  takes  a 
lc»)ger  ti-xe  to  reduce  to  zero.  Since  the  'vehicle*  would  stay  away  from  the 
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trajectory  for  a longer  time*  higher  RHS  error  results. 

Relatively  high  workload  as  well  as  higher  RMS  error  is  observed 
for  the  slower  process  with  longer  preview.  Once  the  threshold  is  eicceeded, 
the  model  applies  an  appropriate  amount  of  control.  However,  due  to  the  slow 
response*  the  magnitude  of  error  remains  near  the  threshold  for  some  time, 
but,  the  error  could  change  sign  as  new  points  come  into  view,  and  might  call 
for  a different  control  action.  Due  to  longer  preview  the  error  changes 
sign  quite  frequently,  resulting  in  increased  control  action.  This  again 
results  in  the  error  remaining  near  the  threshold.  Thus,  behavior  similar  to 
a limit  cycle  results  which,  interestingly,  has  been  observed  when  naive 
subjects  control  slow  processes.  This  could  possibly  be  avoided  by  having 
one  threshold  above  which  control  is  actuated,  and  a lower  threshold  below 
which  control  is  made  zero. 


CONCLUSIONS 

The  next  phase  of  this  work  will  involve  development  of  an 
experimental  situation  for  use  with  human  subjects.  Non-control  tasks  will 
be  included  to  simulate  a multitask  environment.  Simple  arithmetic  tasks  may 
be  used.  Multiplication  tasks  with  keyboard  entry  of  results  are  a 
possibility.  Complexity  and  the  rate  at  which  these  are  presented  could  be 
varied,  so  control  task  error  criterion  (i.e,,  the  threshold'  may  perhaps  be 
manipulated. 


The  possibility  of  developing  analytical  models  using  the  min-max 
approach  [7], [6], [93, CIO],  satisfaction  approach  [11]»and  fuzzy  sets  [12] 
will  be  pursued.  An  attempt  will  be  made  to  cast  our  problem  in  a form 
suitable  for  analysis  using  the  above  methods,  with  possible  modifications 
where  necessary.  Especially  interesting  in  this  regard  is  the  satisfaction 
approach.  It  may  be  possible  to  formulate  our  problem  in  this  framework,  and 
obtain  a heuristic-based  solution  with  the  addition  of  a few  conditions 
related  to  the  problem  structure.  With  these  models  availablei,  a more 
realistic  experiment  will  be  developed  using  the  General  Aviation  Trainer  II 
(GAT  II).  Along  with  the  control  task,  the  non-control  tasks  will  be  made 
more  realistic. 

In  summary,  a simple  heuristic  model  for  the  control  task  was 
presented,  simulation  results  for  a set  of  conditions  describing  various 
trajectcries  were  given.  The  controller  part  assumes  perfect  internal  model. 
Only  the  threshold  must  be  determined  to  yield  Intermittent  control.  The 
period  and  the  preview  length  were  found  to  be  the  most  important  parameters 
affecting  performance.  This  will  form  the  basis  for  proposed  experiments 
with  humans.  The  model  will  be  refined  to  take  into  account  the  results  of 
these  experiments  and  then,  will  be  used  along  with  a queueing  model  for 
non-control  tasks,  to  model  the  overall  multitask  situation. 
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* N79-15596 

tHE  INTERNAL  MODEL:  A STUDY  OF  THE  RELATIVE  CONTRIBUTION 
or  FROPRIOCEFTION  AMD  VISUAL  INFORMATION  TO  FAILURE 
DETECTION  IN  DYNAMIC  SYSTEMS* 

By  Colin  Ketsel  and  chriatophf'r  D.  Wickens 
Department  of  Paychology,  University  of  Illinois 

SU»0iARY 


The  devclopoMnt  of  the  internal  model  as  it  pertains  to  the  detection  of 
step  changes  in  the  order  of  control  dynamics  is  investigated  for  two  modes 
of  participation:  whether  the  subjects  are  actively  controlling  those  dy* 

namics  or  are  monitoring  an  autopilot  controlling  them*  A transfer  of  train* 
ing  design  was  used  to  evaluate  the  relative  contribution  of  proprioception 
and  visual  information  to  the  overall  accuracy  of  the  internal  model*  Six* 
teen  subjects  either  tracked  or  monitored  the  system  dynamics  as  a 2*dimen* 
sional  pursuit  display  under  single  task  conditions  and  concurrently  with  a 
"sub*critical"  tracking  task  at  two  difficulty  levels*  Detection  performance 
was  faster  and  iMre  accurate  in  the  oMnual  as  opposed  to  the  autopilot  auide* 
The  concurrent  tracking  task  produced  a decrement  in  detection  performance  for 
all  conditions  though  this  was  more  narked  for  the  manual  node.  The  develop* 
meiit  of  an  internal  model  in  the  manual  mode  transferred  positively  to  the 
automatic  mode  producing  enhanced  detection  performance*  There  was  no  trans* 
fer  from  the  internal  model  developed  in  the  automatic  sknIc  to  the  auinual 
mode* 


INTRODUCTION 


Over  the  past  few  years  there  has  been  a great  deal  of  research  directed 
at  the  problem  of  detemining  the  differences  between  operators  and  awmitors 
of  dynamic  systems  (References  1*7)*  While  the  conclusions  reached  by  these 
authors  do  not  always  coincide,  there  is  a general  consensur  that  a greater 
understanding  of  the  different  processes  operating  in  the  two  modes  of  parti- 
cipation is  necessary  for  the  successful  integration  of  automated  systems  in 
the  workplace* 

We  have  provided  a detailed  theoretical  analysis  of  the  processes  in- 
volved in  the  two  modes  of  participation  (Reference  7)*  Briefly,  this  anal« 
ysis  has  argued  that  one  way  in  which  the  differences  between  modes  of  parti- 
cipstion  can  be  studied  is  by  determining  the  relative  sensitivity  of  operators 
versus  monitors  in  a failure  detection  task* 

"this  research  was  funded  by  the  Life  Sciences  Program,  Air  Force  Office 
of  Scientific  Reseerch,  Contract  Number  F4A620-76-C-0009*  Dr.  Alfred 
Fregly  was  the  scientific  monitor  of  the  contract* 
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Three  ettrlbutee  were  Identified  that  would  eeeningly  facilitate  failure 
detection  in  the  controlling  aode:  (i)  a smaller  variability  of  the  internal 

<odel  of  the  system;  (ii)  the  options  of  testing  hypotheses  about  the  nature 
of  the  dynamics  by  introducing  signals  into  the  system;  and  (iii)  a greater 
number  of  information  channels  available  upon  which  to  base  failure  detection 
decisions.  It  was  recognised  however,  that  this  latter  advantage  may  b«  tait-^ 
Igated  to  the  extent  that:  a)  adaptation  takes  place  reducing  the  strength 

of  visual  error  information  and,  b)  proprioceptive  sensitivity  Is  less  than 
visual. 

In  comparison  >tUc  monitoring  mod*  was  also  characterised  by  two  attri- 
butes that  could  facilitate  detections:  a greater  "strength"  of  the  visual 

signal  (if  adaptation  by  the  autopilot  does  not  take  place)  and  a lower 
level  of  operator  workload. 

The  study  conducted  (Reference  7)  to  test  the  above  theoretical  analysis 
found  that  detection  performance  in  the  manual  mode  was  faster  and  only 
slightly  less  accurate  than  the  autopilot  mode.  Furthermore  the  observed 
manual  superiority  was  attributed  to  the  additional  proprioceptive  Informa- 
tion resulting  from  operator  control  adaptation  to  the  system  change.  It 
is  possible  that  some  contribution  to  manual  mode  superiority  in  our  prior 
study  resulted  from  the  greater  internal  model  consistency  in  that  mode. 
However  this  hypothesis  was  assuamd  to  be  doubtful  because  a within  subjects 
design  was  employed,  so  that  the  same  subjects  participated  in  both  automatic 
and  manual  conditions.  Thus  the  internal  motel  developed  in  manual  condi- 
tions would  presumably  be  available  to  facilitate  detection  in  the  automatic 
conditions  as  well. 

In  order  to  generate  a greater  distinction  between  the  internal  model 
employed  in  the  two  modes,  the  present  study  employed  a between  subject  de- 
sign using  a transfer  of  training  technique.  This  procedure  enables  an 
examination  of  the  development  of  internal  models,  in  the  two  modes  of  par- 
ticipation, and  subsequently  measures  their  impact  upon  transfer  to  the  other 
mode. 


It  was  hypothesized  that  this  technique  would  Increase  the  differential 
performance  in  detection  bettwen  the  two  modes  of  participation  idtlle  at  the 
same  time  demonstrating  that  the  internal  model  developed  in  the  mamsal  mode 
can  subsequently  be  utilized  to  facilitate  autotsatic  mode  failure  detection 
performance. 


METHOD 


Sublects: 

The  Mubjccts  More  18  right-handed  male  university  students*  Subjects 
were  paid  a base  rate  of  $2 .SO  per  hour  but  could  Increase  tneir  average 
pay  by  maintaining  a high  level  of  detection  performance. 
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Apparatus; 


The  basic  experimental  equipment  included  a 7-«5  x 10  cm  Hewlett  Packard 
Model  1300  CRT  display,  a spring>centered,  dual-axis  tracking  hand  control 
with  an  index-finger  trigger  operated  with  the  right  hand,  and  a spring 
loaded  finger  controller  operated  with  the  left,  A Raytheon  704  16-bit  dig- 
ital Cfxnputer  with'  24k  memory  an<l  A/D,  D/A  interfacing  was  used  both  to  gen- 
erate inputs  to  the  tracking  display  and  to  process  responses  of  the  subject. 
The  subject  was  seated  on  a chair  with  two  arm  rests,  one  for  the  tracking 
hand  controller  and  one  for  the  side-task  finger  controller.  The  subject's 
eyes  were  approximately  112  centimeters  from  the  CRT  display  so  that  the  dis- 
play subtended  a visual  angle  of  1,5°, 

Tracking  tasks.  The  primary  pursuit-tracking  task  required  the  subject 
to  match  the  position  of  a cursor  with  that  of  a target  which  followed  a 
semi-predictable  two-dimensional  path  across  the  display.  The  target's 
path  was  determined  by  vhe  summation  of  two  non-harmonica lly  related  sinus- 
oids (,0S  and  ,08  Hz)  along  each  axis  with  a phase  offset  between  the  axes. 
The  position  of  the  following  cursor  was  controlled  jointly  by  the  subject's 
control  response  and  by  a band-limited  forcing  function  with  a cutoff  fre- 
quency of  ,32  Hz  for  both  axes.  Thus  the  two  inputs  to  the  system  were  well 
differentiated  in  terms  of  predictability,  bandwidth,  and  locus  of  effect 
(target  vs,  cursor).  The  control  dynmaics  of  the  tracking  task  were  of  the 
form  _ 1-a  C(  for  each  axis,  where  <X  was  the  variable 

*c  “ “I  s2 

parameter  used  to  introduce  changes  in  the  system  dynamics.  These  changes, 
or  simulated  failures,  were  introduced  by  step  changes  in  the  acceleration 
constant  a from  a normal  value  of  ,3,  a mixed  velocity  and  acceleration  sys- 
tem, to  a * ,9,  a system  that  approximates  pure  second  order  dynamics  that 
requires  the  operator  to  generate  considerable  lead  in  order  to  maintain 
stable  performance. 

As  the  loading  task,  the  Critical  Task  (Reference  8)  was  employed. 

This  was  displayed  horizontally  in  the  center  of  the  screen  and  required  the 
subject  to  apply  force  to  the  finger  control  in  a left-right  direction  to 
maintain  the  unstable  error  cursor  centered  on  the  display.  The  value  of 
the  instability  constant  X in  the  dynamics  _ k X was  set  at  a 

■ 8 - X 

constant  subcritical  value.  Two  values  (X*  0,5  and  X*  1*0)  were  employed  on 
different  dual  task  trials. 


Experimental  Design  and  Task; 

Three  groups  were  used  in  the  transfer  of  training  design  (see  Figure  1), 
Group  one  transferred  from  manual  (MA_)  on  session  one  to  automatic  (AU..)  on 
session  two;  group  two  transferred  ftkm  automatic  (AU-)  to  manual  (MA._5^«hile 
group  three  was  the  control  group  for  the  automatic  condition  and  monitored 
in  the  automatic  mode  in  both  sessions  (AU_>^  and  AU_  ._.),  The  control 
group  for  the  Mnual  group  (MA_^)  was  MA^,  ^e  varioU 'group  comparisons 
are  represented  in  Figure  1 by^arrows  ano  will  be  referred  to  at  greater 
length  in  the  results  section. 
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Each  group  participated  In  six 
consecutive  days  of  data  collection. 

These  were  divided  Into  two  sessions; 

3 d*ys  In  each  sessloh  with  each  ses- 
sion tottprislng  1 training  day  and 
two  experlinental  days . Subjects  In  , 

group  ohe  for  exanple  participated  In  dual  task  i 
3 Bianual  (MA_)  sessions  and  then  trans- 
ferred to  3 lutooatlc  <AU^^)  sessions. 


In  the  manual  (Mh)  condition  the 
subject  performed  the  tracking  manually 
while  In  the  autopilot  (AU)  condition, 
his  role  In  the  control  loop  was  re- 
placed by  simulated  autopilot  control 
dynamics  consisting  of  pure  gain,  ef- 
fective time  delay,  and  a small  added 
remnant.  Each  trial,  MA  or  AU,  lasted 
ISO  seconds. 


CROUP  2 
DUAL  TASK  I 


CROUP  3 
DUAL  TASK  I 


Figure  1: 


SESSION  1 SESSION  H 

(OATS  1-3)  (DAYS  A-6) 


MAi  L J AUn 


AUi 


MAq 


AUt(c)f 


|AUn(c)f 


Experimental  design  and 
group  comparisons 


Training  Pay;  The  training  day 

was  designed  to  give  the  subject  maximum  experience  and  practice  with  the 
system.  Subjects  therefore  received  extensive  practice  Cracking  (or  moni- 
toring) with  both  prefailure  and  postfailure  dynamics.  Following  this, 
they  observed  and  then  detected  the  step  changes  In  dynamics.  Practice  with 
the  critical  side  task  was  also  Included, 


The  presentation  of  the  failure  was  generated  by  an  algorithm  that  as- 
sured random  Intervals  between  presentations  and  allowed  the  subject  suffi- 
cient time  to  establish  baseline  tracking  perfonaance  before  the  onset  of 
the  next  change.  Task  logic  also  ensured  that  changes  would  only  be  Iritro- 
duced  when  system  error  was  below  a criterion  value.  In  the  absence  of  this 
precaution,  changes  would  sometimes  introduce  obvious  ’’Jumps"  In  cursor 
position. 

During  the  detection  trials,  the  detection  decision  was  recorded  by 
pressing  the  trigger  on  the  control  stick.  This  response  presented  a "T"  on 
the  screen  and  returned  the  system  to  normal  operating  conditions  of  the  pre- 
failure  dynamics.  If  the  subject  failed  to  detect  the  change,  the  system  re- 
turned to  normal  after  six  seconds  via  a 4 second  ramp.  On  the  basis  of  pre- 
test data.  It  was  assumed  that  six  seconds  was  the  Interval  within  tdilch 
overt  responses  would  correspond  to  detected  failures  and  not  false  alarms. 
The  subjects  were  told  to  detect  as  many  changes  as  possible  as  quickly  as 
possible. 

Experimental  Days!  The  training  day  was  followed  by  two  consecutive 
experimental  days.  After  four  refresher  trials  In  the  AU  or  MA  modes  (de- 
pending upon  the  condition)  with  the  side  task,  and  a number  of  demonstrated 
failures,  the  subjects  performed  IS  experimental  trials:  $ single  task, 

tracking  (or  monitoring)  only;  S tracking  with  the  easy  critical  task 
(X*  0,5);  and  S tracking  with  the  difficult  critical  task  (X*  1*0),  The 
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ordet  of  presentation  was  randomized.  Bach  trial  contained  an  average  of  5 
failures  per  trial  with  a range  of  4 to  6* 

The  subject  was  instructed  to  **do  the  side  task  as  efficiently  and  accur* 
ately  as  possible and  told  to  maintain  that  task  at  a standard  level  of  per* 
formance.  After  each  trial  the  subject  received  feedback  about  both  his  side 
task  and  detection  performance.  The  instructions,  feedback  and  payoff  sche* 
dule,  therefore,  clearly  defined  the  side  task  as  the  loading  task  while  al* 
lowing  the  tracking  and  detection  tasks  to  fluctuate  in  response  to  covert 
changes  in  available  attentional  resources  (Reference  9). 

ANALYSIS 


Detection  performance  was  assessed  in  terms  of  the  accuracy  and  latency 
of  responses.  In  computing  the  accuracy  measure,  signal  detection  theory 
analysis  based  upon  the  method  of  free  response  was  employed  (Reference  10). 
This  technique  accounts  for  the  presence  of  hits  and  false  alarms  in  the 
data;  and  the  semi  random  occurance  of  failures  within  a trial.  The  area 
under  the  ROC  curve  (A(R0C])  was  employed  as  the  final  accuracy  measure  (Ref- 
erence 11).  Further  details  of  this  analysis  procedure  may  be  found  in 
Uickens  and  Kessel  (Reference  7,  12). 


The  A(ROC)  measure  and  the  latency  measure  were  then  plotted  in  the  form 
of  a Joint  speed-accuracy  measure  depicted  in  Figure  2.  "Good"  performance 
is  represented  by  points  lying  on  the  upper  left,  in  the  region  of  fast  ac- 
curate response.  Performance  was  quantified  by  projecting  the  point  locus 
obtained  onto  the  positive  diagonal  performance  axis.  The  performance  scale 
is  computed  as  (10  times  A(R0G]  - lATENCY)  and  will  be  called  the  "derived 
performance  score."  This  procedure  pro- 
duces a performance  index  that  ranges 
from  0 for  chance  level  of  accuracy  with 
a latency  of  S"  to  10*0  for  perfect  de- 
tection with  0 second  reaction  time. 

The  units  assigned  to  this  performance 
index  are  somewhat  arbitrary  but  are 
based  on  the  observation  that  the  over- 
all variability  (standard  deviation)  of 
the  raw  latency  scores  were  found  to  be 
roughly  10  times  the  variability  of  the 
A(ROC)  measure. 

RESULTS 


Averages  and  standard  deviations 
were  computed  for  the  accuracy  (A[R0C]), 
the  latency  and  the  derived  performance 
measures  following  the  rational  and  the 
procedures  outlined  in  the  preceding 
section. 


Figure  2:  speed-accuracy  repre- 

sentation of  detection 
performance 
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The  group  averages  for  all  three  ineasures  are  presented  graphically  in 
Figures  3 and  4*  Figure  3 represents  the  results  for  the  single  task  con* 
dition  while  Figure  4 represents  the  dual  task,  workload  condition  collapsed 
over  both  levels  of  dual  task  difficulty  (the  rationale  for  this  procedure 
is  discussed  below).  The  symbols  in  Figures  3 and  4 represent  the  group  re* 
suits  in  the  s peed *accu racy  space,  while  the  arrows  and  labels  depict  the 
derived  performance  scores  for  the  various  groups  along  the  performance  axis. 
In  figures  5,  6,  and  7 the  experimental  groups  are  plotted  with  the  average 
derived  performance  score  on  the  Y*axis. 

The  presentation  of  the  results  of  the  detection  of  failures  will  be 
divided  into  three  sections.  The  first  presents  the  results  for  each  mode  of 
participation,  and  represents  a replication  of  the  Wickens  and  Kessel  (Refer* 
ence  7)  study  with  the  between  subjects  design,  the  second  examines  the  re* 
suits  of  the  loading  task,  while  the  third  reports  the  results  of  the  trans* 
fer  of  training  experiment.  Group  differences  were  analysed  by  means  of  a 
3*way  Analysis  of  Variance *ANOVA  (groups  x dual  task  x experimental  days). 


IS 


Figure  3:  Effect  of  participatory  mode  and  experimental  condition 
on  detection  performence*Single  Teak 
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(a)  Mode  of  Participation 


The  most  pronounced  effect  in  the  experimental  data  is  the  consistent 
superiority  of  MA  over  AU  detection.  This  statistically  reliable  effect  is 
clearly  evident  in  the  derived  performance  score  shovm  in  Figures  5 and  6 
and  vas  tested  by  contrasting  group  AU_  with  MA.  (P.  * 18.4  p < «001). 

Examination  of  Figurcii  3 and  4 reveals^that  the^  Ift^riorlty  is  reflected 
in  detection  latency  (P.  p < .01),  as  well  as  accuracy  (P,  *■ 

15.55.  p < .01). 

While  these  findings  essentially  replicate  the  Wickens  and  Kessel  (Ref> 
erence  7)  study,  it  is  important  to  note  that  the  extent  of  MA  superiority 
observed  in  the  present  results  is  greatly  enhanced.  In  fact  the  orngnitude 
of  the  MA*AU  difference  in  the  desired  performance  score  is  roughly  five 
tiams  its  value  obtained  in  the  previous  within-subject  design.  Contrasting 
the  two  studies,  one  finds  that  AU  performance  is  unchanged,  but  MA  perform- 
ance  in  the  present  results  is  reliably  superior  to  its  level  in  the  previous 
study  (tj  » 2.18.  p < .05).  These  findings  add  strength  to  the  argument 


Figure  4t  Effect  of  participatory  mode  end  experimental  condition 
on  detection  performaneeJMial  Task 
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Figure  6 

Detection  perfomance  as  a function  of  experinental  condition 


Figure  7:  Bffect  of  dual  task  on 
detection  perforaanca 


Figure  8:  Bf facta  of  dual  task 
on  aanual  tracking 
and  critical  task 
parfoiwinca 
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that  internal  models  developed  separately  tend  to  be  more  consistent,  less 
variable  and  more  sensitive  to  system  changes. 


By  comparing  the  single  task  performance  in  MB  . vith  AU-_  (see  Figures 
3 and  5)  it  is  possible  to  detemine  fdiether  MA  supeHority  is^maintained  af- 
ter prior  training  in.  the  other  mode  of  participation.  From  Figures  3 and 
5 we  can  see  that  while  this  difference  has  been  reduced  somewhat,  the  over- 
all MB  superiority  remains  intact.  This  MB  _-AU.-  group  difference  is  also 
statistically  reliable  (F^  ■ 6.76,  p < .05). 

(b)  Critical  Task 


the  impact  of  the  critical  tracking  task  may  be  evaluated  both  as  it  af- 
fected detection  performance  (Figure  7)  and,  in  the  MB  mode,  as  it  affects 
performance  of  the  primary  tracking  task  (Figure  8).  From  Figure  7,  it  is 
evident  that  the  introduction  of  the  CT  produced  a decrement  in  detection. 

As  might  be  expected,  the  decrement  in  the  MB  mode  was  senevhat  more  pro- 
nounced. While  there  was  no  decrement  for  the  BU.  groups  there  it  a sub- 
stantial decrement  for  the  All.,  groups,  equivalent  to  the  decrement  of  both 
the  mB  groups.  For  both  the  and  the  MB.  -AU..  analyses,  task  load- 
ing showed  a statistically  xeliableSffect  (F-  ,0  " P < *05;  F.  “ 

S.AS,  p < .025  respectively).  It  should  be  noteo  however  that  the  primary 
impact  of  this  effect  is  localised  in  the  introduction  of  the  critical  task, 
and  ;iot  with  the  Increase  in  its  difficulty  level,  a point  bom  out  by  fur- 
ther statistical  analysis.  (The  near  equivalence  of  the  two  dual  task  con- 
ditions was  the  Justification  for  collapsing  detection  performance  over  the 
two  conditions  in  further  analysis.) 


Figure  8 reveals  that  the  critical  task  had  a clear  influence  on  MB 
tracking  perfoxmance,  both  with  its  introduction,  and  with  the  increasing  dif- 
ficulty. Bnalysis  performed  on  the  MB.  and  MB.,  data  alone^  indicated  that 
the  effect  was  statistically  reliable  (F2  20  P ^ *001). 

Finally,  Figure  8 reveals  slight,  but  consistent,  decreases  in  critical 
tracking  performance  that  occur  as  a result  of  increasing  X*  These  increases 
were  found  to  be  statistically  reliable  for  all  the  groups.  Since  the  sub- 
jects were  all  treating  the  critical  task  as  a loading  task  it  can  be  con- 
cluded that  the  increase  in  X feet  did  serve  to  divert  attentional  resources 
from  the  primary  tracking/detection  process. 


(c)  Transfer  of  Trainina 

Manual  Mode.  In  determining  the  relative  amount  of  transfer  to  the  man- 
ual mode  resulting  from  prior  automatic  training,  the  MB.,  group  is  compared 
with  its  control  group  MB.  (Figure  1)  which  essentially  nid  no  prior  exper- 
ience in  the  failure  detection  task. 

Htaturally  BU  "tracking"  performance  remains  unaffected  by  critical 
task  difficulty  level. 
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Prom  Figures  3 through  7 it  can  be  seen  that  in  general  there  ia  an 
overall  Mh..  superiority  over  MA  for  both  single  and  dual  task  conditions. 
However  thS^AMOVA  failed  to  reveal  these  differences  to  be  statistically  re- 
liable, Examination  of  the  data  on  a day  by  day  basis  reveals  that  the  over- 
all difference  is  due  to  large  differences  that  exist  on  day  1 which 

appear^ to  dissipate  completely  when  the  two  groups  are  compared  on  day  2 per- 
formance . This  finding  can  be  seen  as  support  for  the  basic  hypothesis  that 
exposure  to  prior  AU  tracking  and  the  development  of  an  internal  model  based 
on  visual  cues  only,  produces  only  a small  and  transient  facilitation  of 
subsequent  development  of  the  internal  model  based  on  MA  tracking. 

Automatic  Mode,  The  degree  of  transfer  resulting  from  prior  MA  train- 
ing to  the  AU  mode  is  reflected  in  the  performance  of  subjects  in  condition 
AU-.,  and  the  comparison  of  this  performance  with  that  of  the  control  group 

Figures  S and  6,  it  is  evident  that  the  latter  group 
faildfl^to  oenerit  at  all  from  prior  AU  training,  an  observation  supported  by 
the  lack  of  statistical  reliability  of  the  main  effect  when  AU.^^  and  AU-.... 
are  compared.  In  marked  contrast.  Figures  5 and  6 suggest  that'cne  AU--  ^*>^7 
group  in  fact  showed  considerable  benefit  from  their  prior  MA  trainlngHhen 
their  performance  is  contrasted  with  that  of  the  AU  group.  In  Figure  5, 
the  magnitude  of  this  effect  is  seen  to  be  considerably  larger  than  the  ef- 
fect for  the  control  group  or  for  the  MA--MA--  contrast  discussed  in  the  pre- 
ceding section.  * 

The  statistical  reliability  of  thia  improvement  on  the  single  task  data 
was  assessed  by  a groups  (AU^  vs.  AU^^)x  days  (Day  1 vs.  Day  2)  2 x 2 AMOVA, 

Both  main  effects  were  statistically  reliable.  This  indicates  that  (a) 
both  groups  improved  with  practice  (over  two  days)  in  their  respective  AU 
conditions  (F,  .q  • 14.77,  p < .001),  (b)  More  crucially,  from  the  viewpoint 
of  the  hypothelis  under  investigation,  the  AU..  group  performed  reliably 
better  than  did  the  AU.  group  (F.  • S.19,  p*<  ,0S),  It  Is  of  course  pos- 

sible to  argue  that  this  effect  fAfulted  from  greater  exposure  to  and  fami- 
liarity with  the  overall  experimental  environment  experienced  by  the  AU-, 
group  and  not  to  transfer  of  the  internal  model.  However  thia  interpretltion 
appears  unlikely  because  the  control  group  failed  to  show  any  such  *'general- 
Ued*'  transfer. 


We  ean  conclude  that  there  is  a transfer  from  MA  to  AU.  The  AU.-AU,- 
dlfferences  are  very  large  and  statistically  reliable  and  as  such  support^ 
the  basic  hypothesis  that  while  there  are  different  sets  of  cues  operating, 
the  MA  condition  produces  an  internal  model  of  the  system  that  can  be  util- 
ised to  advantage  in  subsequent  automatic  monitoring. 


SUIMARY  AND  CONCLUSIONS 


The  major  results  can  be  aiamrised  as  follows: 

1)  Detection  of  step  increases  in  system  order  when  the  operator  remains 
in  the  control  loop  (MA  m^e)  is  considerably  faster  and  more  accurate  than 
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when  he  is  removed  (All  node).  This  finding  is  consistent  with  both  the  find* 
ings  of  Young  (Reference  2)  end  of  Wiekens  end  Kessel  (Reference  7). 

2)  The  msnual  node  superiority  was  found  to  be  nore  pronounced  in  this 
between  subject  design  then  the  previous  within  subject  study  (Reference  7). 
This  difference  can  be  attributed  to  the  fact  that  the  subjects  were  allowed 
to  develop  separate  internal  nodels  for  either  the  nanual  or  the  autonatic 
node,  thereby  producing  nodels  that  were  always  appropriate  for  the  node  of 
participation  employed. 

What  is  interesting  in  contrasting  the  two  studies  is  the  fact  that  AU 
performance  is  virtually  identical.  The  effect  of  the  bet%wen*subjeeta  mani* 
pulation  instead  seems  to  have  been  to  produce  a large  improvement  in  MA 
detection. 

This  result  suggests  that  in  the  previous  experiment  the  AU  internal 
model  was  developed  unhindered  by  the  concurrent  development  of  the  MA  inter* 
nal  nodel  while  the  reverse  situation  did  not  hold.  It  would  appear  that 
the  development  of  the  MA  internal  nodel  in  the  previous  experiment  was  some* 
how  subject  to  interference  fron  the  AU  model  developnent,  suggesting  that 
subjects  were  paying  attention  to  non*relevant,  visual  cues.  It  has  been  ar* 
gued  (Reference  7)  that  the  sensitivity  to  proprioceptive  information  is 
reduced  relative  to  visual  information  particularly  when  the  two  sources  are 
available  at  the  saam  time  and  are  conveying  conflicting  information  (Refer* 
enees  13,  14,  IS).  In  the  AU  mode  the  subjects  have  only  visual  cues  as  in- 
formation while  in  the  MA  mode  both  visual  and  proprioceptive  information 
is  available.  Thus  in  the  previous  study,  during  the  development  of  the  MA 
internal  models  there  were  times  when  these  cues  might  be  in  conflict  and 
subjects  tended  to  fall  back  on  the  visual  cues  learned  in  the  AU  mode.  This 
produced  an  over*emphasia  on  the  visual  cues  and  a subsequent  degrading  of 
the  crucial  proprioceptive  information.  The  introduction  of  the  between  sub* 
jeet  design  forced  subjects  to  develop  separate  internal  models  based  upon 
the  relevant  cues  available  within  each  condltion**a  situation  that  has  an* 
hanced  the  MA*AU  differences  found  in  the  previous  experiment. 

3)  The  overall  MA  superiority  is  evident  in  both  single  and  dual  task 
conditions.  The  effect  of  adding  the  Critical  Task  was  to  raduec  the  overall 
detection  performance  via  a reduction  in  the  accuracy  of  detections  and  an 
increase  in  response  latencies.  The  impact  of  the  second  task  was  more  marked 
for  the  mA  condition  than  tha  AU  condition.  This  result  is  consistent  with 
the  fact  that  the  critical  tracking  task,  placing  heavy  demands  upon  the  sub* 
Jeet's  response  mechanism,  produced  an  increase  in  interference  at  the  struc* 
tural,  motor  level  of  performance  in  the  MA  mode  that  was  not  present  in  the 
AU  mode  of  operation.  Increasing  the  difficulty  of  the  subcritioal  loading 
task  appeared  to  have  little  effect  on  detection  performance  in  either  mode, 
although  it  did  serve  to  disrupt  tracking  performance. 

4)  An  analysis  of  the  transfer  of  training  experiment  shows  that  there 
is  very  little  transfer  from  the  automatic  mode  to  the  manual  mode.  This  fact 
adds  further  weight  to  the  argument  that  the  development  of  the  internal  model 
for  the  manual  mode  cannot  utilise  to  advantage  the  internal  sMdel  developed 
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for  tho  autoMtic  0Mda«  Tht  addition  of  the  proprioceptive  channels  and  the 
interactive  describing  function  in  the  manual  node  appears  to  require  the  de- 
velopment of  a separate  and  unique  intsmal  model* 

5)  There  does  appear  to  be  positive  transfer  from  the  manual  mode  to 
the  automatic,  a finding  that  supports  the  basic  hypothesis  outlined  above 
that  vhile  there  are  different  sets  of  cues  operating,  the  MA  mode  produces 
an  internal  model  of  the  system  that  can  be  utilised  to  advantage  in  subse- 
quent automatic  monitoring* 

6)  Finally,  the  successful  transfer  from  manual  to  automatic  and  the 
lack  of  transfer  from  the  automatic  to  the  manual  modes  tends  to  add  weight 
to  the  basic  hypothesis  outlined  above*  This  hypothesis  states  that  the  in- 
ternal models  developed  in  different  m^es  of  participation  are  relatively 
independent  and  therefore  care  sniat  be  exercised  in  extrapolating  expected 
results  in  one  mode  of  participation  from  performance  in  the  other* 
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ABSTRACT 


Recent  interest  in  the  areas  of  modeling  the  effects  of  motion  on  human 
operators,  and  manual  control  of  low  bandwidth  systems  has  led  to  the  need 
for  accurate  submodels  of  the  low  frequency  characteristics  of  the  Human 
Operator  (HO).  Unfortunately,  matching  low  frequency  human  response  data 
has  been  a problem  with  almost  all  HO  models,  the  well  known  Optimal  Control 
Model  (OCM)  being  no  exception.  This  research  is  an  attempt  to  better  under- 
stand and  hopefully  eliminate  these  problems. 

In  this  paper,  properties  of  several  structural  variations  in  the  neuro- 
motor  interface  portion  of  the  OCM  are  investigated.  For  example,  it  is 
known  (1-2]  that  commanding  control-rate  Introduces  an  open-loop  pole  at 
S“0  and  will  generate  low  frequency  phase  and  magnitude  characteristics 
similar  to  experimental  data.  However  this  gives  rise  to  unusually  high 
sensitivities  with  respect  to  motor  and  sensor  noise-ratios,  thereby  reducing 
the  models'  predictive  capabilities.  Relationships  for  different  motor  sub- 
models are  discussed  to  show  sources  of  these  sensitivities.  The  models  in- 
vestigated include  both  pseudo  motor-noise  and  actual  (system  driving)  motor- 
noise  characterizations.  The  effects  of  explicit  priprloceptlve  feedback 
in  the  OCM  is  also  examined.  To  show  graphically  the  effects  of  each  sub- 
model on  system  outputs,  sensitivity  studies  are  Included,  and  compared  to 
data  obtained  from  (1-2]. 


INTRODUCTION 


Recently,  motion  studies  (2,3]  have  shown  the  major  effects  of  motion 
to  be  on  low  frequency  («  < 1 rad/sec)  HO  magnitude  and  phase  characteristics. 
This  means  that  low  frequency  modeling  errors  present  in  the  baseline  im- 
plementation of  the  OCM  must  be  minimized  if  the  effects  of  including  motion 
variables  are  to  be  felt.  It  is  known  (1,2]  that  changing  the  structure  of 
the  neuro-motor  interface  portion  of  the  OCM  will  give  the  desired  low  fre- 
quency effects.  Specifically  if  the  HO  commands  control  rate  rather  than 
control,  the  low  frequency  phase  drooping  occurs.  However,  in  order  to  match 
human  response  data  over  simple  vehicle  dynamics,  large  deviations  in  the 
motor  noise  ratios  were  needed  [2].  This  clearly  degrades  the  predictive 
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power  of  the  model.  In  this  paper  sub-models  developed  in  [1*2]  will  be 
compared  from  a sensitivity  point  of  view,  in  an  attempt  to  better  under- 
stand the  limitations  of  each  approach. 


Problem  Formulation 


In  this  section  structural  changes  will  be  made  to  the  baseline  OCM 
(for  a more  detailed  description  see  Levison  [2]).  A general  form  will  be 
developed  first,  with  specific  models  Introduced  as  special  cases  to  it. 

In  the  development  which  follows,  the  time  delay  will  be  ignored  since  it 
has  little  bearing  on  our  discussion. 

The  system  being  controlled  Is  described  by  the  state-space  equation 
X = Ax  + Bu  + Ew  (1) 


where: 


X ® "true"  system  state 
u « "true"  control  input 

and  where  displayed  system  variables  are  given  by 

y * Cx  + Du  (2) 

The  system  is  assumed  to  be  controlled  to  minimize  (in  steady-state) 
a quadratic  cost  functional 

J » E(y'  Qy  y + g u^>  (3) 

based  on  the  (delayed  and)  noisy  information  perceived  by  the  HO,  This  in- 
formation is  assumed  to  consist  of  both  displayed  and  proprioceptive  vari- 
ables, i.e.. 


u = u + V 
P u 


where: 


y 


+ V 

y 

(4a) 

(4b) 

+ p E{y^} 

y 

(5a) 

+ p E{u^} 
u 

(5b) 

The  control  law  that  minimizes  J is  given  by 

Si 


u - -IL^  L^] 


A . 

* u. 


where: 

^ > human's  best  internal  estimate  of  x 

Q - •*  " •*  u 


(6) 
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To  model  any  actual  noise  at  the  motor  end,  a driving  motor  noise  is 
added  to  (6).  Notice  control  rate  is  generated  rather  than  control*  Thus, 

u * u + V.  (7) 

c u 

where : 2 

cov{v*}^  V*  + p*  E{u  } (8) 

u u u c 

However  the  human *s  internal  representation  of  the  neuromotor  interface, 

Eq.  (7),  is: 

u = u + V (9) 

c p 

where:  2 

cov{v  V + p E{u  } (10) 

p p p c 

and  typically  covCv  } f cov  {v.}  • 

p u 

The  pseudo  motor  noise  Vp  does  not  act  as  a driving  noise  to  the  system, 
but  instead  degrades  performance  by  making  estimation  sub-optimal  [2]. 

Implementing  these  changes  gives  rise  to  the  structure  shown  in  Fig*  1. 


W 


"Proprioceptive  Channel"  '^u 


FI6.1  REVISED  OPTIMAL  CONTROL  MODEL. 
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The  particular  submodels  considered  in  this  study  are  as  follows: 
Driving  Noise  Models: 

1)  covvv  } = coviv*}  > i.e*,  optimal  estimation  occurs,  driving  motor 
noise^equal  to  v^ 

• proprioceptive  information  available 

2)  Same  as  model  (1) , except  no  proprioceptive  information  available 
Pseudo  noise  models: 

3)  V.  = 0,  i.e*,  sub-optimal  estimation  occurs,  only  pseudo  noise 

ptesent 

• proprioceptive  information  available 

4)  Same  as  model  (3)  except  no  proprioceptive  information  available 


SENSITIVITY  RESULTS 


Data  from  [1,2]  was  matched  using  each  of  the  aforementioned  models « 
Only  K/S  and  K/S**2  dynamics  were  considered.  The  reader  is  referred  to 
the  sensitivity  studies  included  in  [1]  so  a comparison  can  be  made  to  the 
baseline  model. 


K/S  Dynamics 


The  following  nominal  parameters  were  found  to  give  reasonable  matches 
to  the  data.,  and  will  be  used  as  a basis  for  the  K/S  sensitivity  work. 
Notice  that  proprioceptive  feedback  is  not  needed  for  K/S  dynamics;  this 
agrees  with  findings  in  [1,2].  Therefore,  for  K/S  dynamics  we  need  only 
consider  two  models,  driving  noise  and  pseudo  noise. 


SNR  = p 
SNR  - u = p 

u 

MNR  = p.  or  p 
u 

TD  = T,  TN  = L 

u 

It  was  found  that  the  trends  discussed  in  [1]  for  SNR,  TD  and  TN  were 
the  same  for  all  the  models  considered.  The  only  exception  to  this  was  for 
the  driving  noise  models,  where  the  low  frequency  remnant  curves  were  slight- 
ly higher. 


Model 

SNR 

SNR-u 

MNR 

TD 

TN 

1 & 3 

-20 

—00 

-40 

.17 

.08 

2 & 4 

-20 

-40 

.17 

.08 

Effects  of  MNR 


From  Pig.  2 it  is  clear  that  motor  noise  mainly  affects  the  low  f re- 
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FIQ.2,  effects  of  mnr  on  k/s  dynamics. 
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quency  portion  of  Che  magnitude,  phase  and  remnant  curves.  There  are  bas- 
ically two  reasons  for  this.  First, the  shape  of  the  low  frequency  portion 
is  due  to  Che  integrator  at  Che  motor  end  (where  in  Che  baseline  OCM, 
l/(TjjS+l)  was  present).  Secondly,  the  sensitivity  is  due  to  the  degradation 
of  estimation  performance  as  Che  motor  noise  is  increased.  Because  Che  level 
of  the  driving  noise  is  so  low,  the  linear  part  of  the  HO  model  (Bode  plot) 
is  the  same  whether  pseudo  noises  or  driving  noises  are  used.  Notice  that 
Che  driving  noise  has  a dominant  affect  only  on  the  low  frequency  remnant. 

All  scores  increase  with  Increasing  motor  noise.  Scores  using  Che 
pseudo  model  are  fairly  Insensitive  to  motor  noise,  since  it  is  the  degraded 
estimation  which  causes  them  Co  change.  Scores  using  the  driving  model  are 
much  more  sensitive  to  motor  noise,  since  increasing  Che  motor  noise  in- 
creases the  remnant  in  the  system. 


K/S**2  Dynamics 


The  following  is  the  nominal  parameter  set  found  for  K/S**2  dynamics. 


Model 

SNR 

SNR-u 

MNR 

TD 

TN 

1 & 3 

-20 

-25 

mn 

.21 

fl 

2 & 4 

-20 

1 

1 

1 

B 

.21 

■ 

Here,  as  in  K/S  dynamics,  trends  discussed  in  [1]  for  SNR,  TD,  and  TN 
also  hold  for  our  revised  models.  Below  we  discuss  only  the  effects  of  MNR 
& SNR  on  control. 


Effects  of  MNR 

No  Proprioceptive  Information  (models  2 & 4) 


Looking  at  Figure  3 it  is  clear  that  the  motor  noise  affects  the  low 
frequency  Bode  plots  in  a manner  similar  to  that  found  for  K/S  dynamics. 
Again,  more  remnant  power  is  shifted  to  the  low  frequencies  for  model  2 than 
for  model  4. 

Notice  that  model  4 matches  the  low  frequency  remnant  very  poorly  (this 
could  be  Improved  slightly  by  increasing  the  noise  on  displayed  error)  and 
may  be  interpreted  as  a major  shortcoming  of  this  model  since  we  desire  a 
nominal  set  of  parameters. 
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With  Proploceptive  Tnformatlon  (Models  2 & 4) 


The  effects  of  including  proprioceptive  feedback  can  be  seen  by  compar- 
ing Figs.  3 & 4.  Again  remnant  is  higher  for  driving  motor  noises,  but  ib 
Is  spread  out  over  a wider  band  of  frequencies.  This  may  be  due  to  the 
circulation  of  remnant  in  the  feedback  loop.  Although  not  shown,  the  scores 
for  model  1 were  always  higher  and  more  sensitive  than  those  for  model  3, 
and  seemed  to  match  the  data  better. 

Notice  that  the  sensitivity  of  the  model  to  changes  in  the  motor  noise 
has  been  reduced  dramatically  by  Including  proprioceptive  feedback.  Because 
the  model  now  has  observations  of  control  and  control  rate  to  use  in  forming 
an  estimate  of  control,  estimation  stabilizes  and  improves. 


Effects  of  SNR  (Models  1 & 3) 


Figure  5 shows  the  low  frequency  remnant  for  model  3 much  closer  to 
that  of  model  1.  Notice  if  the  sensor  noise  is  too  large  (>-lSdB),  the 
model  ignores  this  observation  and  models  1 & 3 effectively  become  models 
2 & 4.  Since  knowledge  of  the  control  signal  is  Important  in  this  task, 
it  is  clear  that  the  model  should  be,  and  is,  sensitive  to  the  quality  of 
this  information.  The  low  frequency  effects  result  primarily  from  the  move- 
ment of  the  estimator  poles. 


Sensitivity  of  Scores 


Relative  RMS  error  is  plotted  in  Fig.  6 as  a function  of  MNR.  Because 
RMS  error  is  the  most  sensitive  score,  Fig.  6 shows  that  including  proprio- 
ceptive feedback  reduces  the  sensitivity  of  all  the  scores. 


Review 


From  the  sensitivities  studies  it  was  seen  that  in  general: 

t All  predicted  scores  were  lower  than  measured  ones  for  pseudo  noise 

» All  system  measures  were  more  sensitive  to  driving  motor  noise  than 
to  pseudo  noise 

' This  sensitivity  can  be  reduced  by  including  an  observation  of  con- 
trol 

% The  level  of  sensor  noise  on  control  Induces  the  low  frequency 
effects 

* The  Integrator  at  the  motor  end  confines  the  remnant  power  to  the 
low  frequencies 
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FIG.  6;  SENSITIVITY  OF  RMS  ERROR  (K/S**2  TASK) 


• It  is  difficult  to  match  K/S**2  data,  with  a nominal  aet  of  para- 
meters, using  models  2 & 4 


FINAL  COMMENTS 


Sensitivity  studies  have  shown  that  including  observations  on  control 
can  reduce  model  sensitivity  to  driving  motor  noises.  Also  it  was  shown 
that  a sensor  noise  added  to  control  does  not  greatly  affect  the  uncorre- 
lated part  of  the  model.  Nominal  parameters  were  found  that  could  match  K/S 
& K/S**2  dynamics,  provided  that  observations  on  control  are  Included  for 
K/S**2  but  not  for  K/S.  If  the  model  is  allowed  to  allocate  attention  free- 
ly among  all  observed  variables,  this  may  provide  a scheme  for  determining 
the  sensor  noises.  One  hypothesis  is  that  this  essentially  forms  a decision 
step  (perhaps  as  part  of  the  learning  process)  in  the  HO  model,  where  It 
must  evaluate  the  benefits  of  all  the  cues  It  has  available  to  It  and  then 
decide  on  a subset  which  will  be  useful  for  control  purposes. 

More  work  needs  to  be  done  In  order  to  find  a good  rule  for  picking  the 
sensor  noises.  Testing  models  1 and  3 over  a wider  set  of  system  dynamics 
is  also  Important  to  see  it  our  findings  are  true  in  general  or  Just  a . 
special  case. 


Ill 
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THE  EFFECTS  OF  SIMULATOR  CHARACTERISTICS* 
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ABSTRACT 

The  optimal  control  model  (OCM)  of  the  human  operator  ia  used  to  develop 
closedoloop  models  for  analysing  the  effects  of  (digital)  simulator 
oharaoteristios  on  predicted  performance  and/or  workload.  Two  approaches  are 
considered:  the  first  utilizes  a continuous  approximation  to  the  discrete 

simulation  in  conjunction  with  the  standard  optimal  control  model;  the  second 
Involves  a more  exact  discrete  description  of  the  simulator  in  a closed* loop 
multi-rate  simulation  in  which  the  optimal  control  model  "simulates*  the  pilot. 
Both  models  predict  that  simulator  characteristics  can  have  significant  effects 
on  performance  and  workload. 


1.  nmoDocnoR 

The  development  of  engineering  requirements  for  man- in- the- loop  digital 
simulation  is  a complex  task  involving  numerous  trade-offs  between  simulation 
fidelity  and  costs,  accuracy  and  speed,  etc.  The  principal  issues  confronting 
the  developer  of  a simulation  involve  the  design  of  the  cue  (motion  and  visual) 
environment  so  as  to  meet  simulation  objectives  and  the  design  of  the  digital 
simulation  model  to  fulfill  the  real-time  requirements  with  adequate  accuracy. 

The  design  of  the  simulation  model  has  become  increasingly  important  and 
difficult  as  digital  computers  play  a more  central  role  in  the  simulations.  For 
real-time  digital  simulation  with  a pilot  in  the  loop  the  de'^ign  problem 
involves  specification  of  conversion  equipment  (A-D  and  D-A)  as  well  act  of  the 
discrete  model  of  the  system  dynsmios.  The  design  of  an  adequate  discrete 
simulation  is  also  related  closely  to  the  cue  generation  problem  inasmuch  as  the 
errors  and,  in  particular,  the  delays  introduced  by  the  simulation  will  be 
present  in  the  information  cues  utilized  by  the  pilot.  The  significance  of  this 
problem  has  been  amply  demonstrated, Of  course,  human  pilots  oan  oompensate 
for  model  shortcomings  as  well  as  for  those  of  cue  generation,  with  possible 
effects  on  the  subjective  evaluation  of  the  simulation. 

The  objective  of  the  work  reported  here  was  to  develop  a closed  loop 
analytic  model,  incorporating  a model  for  the  human  pilot  (namely,  the  optimal 
control  model),  that  would  allow  certain  simulation  design  tradeoffs  to  be 
evaluated  quantitatively  and  to  apply  this  model  to  analyze  a realistic  flight 
control  problem.  The  effort  concentrated  on  the  dynamic,  closed  loop  aspects  of 


*The  work  described  herein  was  performed  under  Contract  No.  NSA1-1hb49  for  NASA 
- Langley  Research  Center.  Mr.  Russell  Parrish  was  the  Technical  Monitor  and 
contributed  many  helpful  suggestions. 


the  simulation.  Problems  associated  with  perceptual  issues  in  cue  generation 
were  not  considered.  However,  the  limitations  imposed  by  the  dynamics  of  visual 
. cue  generation  equipment  are  considered  and  the  model  can  be  readily  extended  to 
incorporate  the  dynamics  associated  with  motion  simulation. 

The  optimal  control  model  of  the  human  operatqr^*^  is  central  to^the  closed 
loop  analysis  techniques  that  have  been  employed.  This  model  has  been  validated 
and  applied  extensively  and  has  a structure  that  is  well-suited  to  analysis  of 
the  simulation  problems  of  interest < The  model  can  be  used  to  generate 
predictions  of  attentional  workload  as  well  as  of  closed-loop  performance.  This 
is f significant  because,  as  noted  earlier,  pilots  may  compensate  for  simulation 
Shortcomings  but  with  a workload  penalty;  such  simulation- induced  operator 
tradeoffs  need  to  be  explored. 

Two  approaches  to  closed- loop  modelling  are  considered.  The  first  employs 
a continuous  approximation  to  the  open-loop  dynamics  of  the  digital  simulation 
in  conjunction  with  the  standard  OCM.  The  second  model  attempts  to  represent 
the  discrete  simulation  dynamics  more  exactly.  It  utilizes  a simulation  version 
of  the  OCM.  This  latter  model  is  referred  to  as  the  hybrid  model. 

In  the  remainder  of  this  paper,  the  closed  loop  models  are  described  and 
some  results  of  applying  the  models  are  presented  and  discussed.  More  extensive 
discussion  and  additional  results  may  be  found  in  Reference  5. 


2,  OONTUroOOS  CLOSED  LOOP  MODEL 


Figure  1.  Simplified  Model  for  Closed  Loop  Analysis  of  Digital  Simulation 

Figure  1 is  a block  diagram  of  a simplified  closed-loop  model  for  analyzing 
problems  in  digital,  piloted  simulation.  The  pilot  model  in  Figure  1 is  the 
OCM. 3*^  The  elements  corresponding  to  the  simulator  are  an  analogs* to-dlgital 
converter  (ADC),  a digital  computer  (CPU),  a digital-to-analog  converter  (DAC) 
and  a visual  display  system.  Briefly,  the  ADC  is  a sampler  preceded  by  a 


114 


'IdW'pads  filter  included  to  minimize  aliasing  effecibs,  the  OPU  implements 
difference  equations  so  as  to  simulate  the  vehicle's  response  to  the  pilot's 
(sampled)  input,  the  DAC  is  a data-hold  (either  zero-order  or  first-order),  and 
the  visual  display  system  is  a servo-driven  projector  that  continuously  displays 
target  position  (relative  to  the  aircraft)  to  the  pilot.  These  elements  will  be 
discussed  in  more  detail  below. 

2.1  'Optimal  GiMitrol  Model  for  Pilot 

$ome  of  the  features  of  the  OCM  that  are  particularly  relevant  to 
subsequent  discussions  are  reviewed  briefly  here.  Figure  2 illustrates  the 


HUMAN  OPERATOR  MODEL 


Figure  2.  Structure  of  Optimal  Control  Model 
structure  of  the  OCM. 


115 


The  OCM  as' originally  conceived  and  developed  presupposes  that  the  system 
d^hamlcSt  corresponding  to  the  element  to  be  controlled!  may  be  expressed  in 
state  variable  format 


i(t)  - A^^(t)  + B^u(t)  + w(t) 


(1) 


y(t)  = C^xCt)  + D^tt(t) 


where  x is  the  n-dimensional  state- vector , y is  an  m-dimensiopal  vector  of 
displayed  outputs!  a is  the  r-dimensional  control  input  vector  and  w is  a vector 
cif  disturbance  and/or  command  inputs.  The  system  matrices  (Aq!  Be  Gc,  Dq,  Eq) 
are  generally  asSiuaed  to  be  time- invariant,  although  this  restriction  can  be 
relaxed.  The  above  system  dynamics  include  the  linearized  dynamics  of  the 
aircraft  (or  other  controlled  element)  and  any  dynamics  associated  with 
measurement!  control  and  display  systems.  The  subscript  c on  the  system 
matrices  is  included  to  emphasize  that  the  dynamics  are  assumed  to  represent  a 
continuous  system. 


For  purposes  of  discussion  it  is  convenient  to  consider  the  model  for  the 
pilot  as  being  comprised  of  the  following:  (i)  an  "equivalent"  perceptual  model 
that  translates  displayed  variables  into  noisy!  delayed  perceived  variables 
denoted  by  yp  (t);  (ii)  an  information  processing  model  that  attempts  to 
estimate  the  system  state  from  the  perceived  data.  The  information  processor 
consists  of  an  optimal  (Kalman)  estimator  and  predictor  and  it  generates  the 
minimum-variance  estimate 'xCt)  of  x(t);  (iii)  a set  of  "optimal  gains"!  L*! 
chosen  to  minimize  a quadratic  cost  functional  that  expresses  task  requirements; 
and  (iv)  an  equivalent  "motor"  or  output  model  that  accounts  for  "bandwidth" 
limitations  ( frequently  associated  with  neuromotor  dynamics)  of  the  human  and  an 
inability  to  generate  noise- free  control  inputs. 


The  time  delay  or  transport  lag  is  intended  to  model  delays  associated  with 
the  human.  All  displayed  variables  are  assumed  to  be  delayed  by  the  same 
amount,  viz.  ^ seconds.  However,  delays  introduced  by  the  simulation  can  be 
added  to  the  human's  delay  without  any  problem,  so  long  as  all  outputs  are 
delayed  by  the  same  amount.  If  such  is  not  the  case,  then  all  outputs  can  be 
delayed  by  T , where  t is  now  the  sum  of  the  minimal  delay  Introduced  by 
the  simulation  and  the  operator's  delay,  and  additional  delays  for  the  outputs 
requiring  them  can  be  modeled  via  Inclusion  of  Fade  approximations  in  the  output 
path. 


The  observation  and  motor  noises  model  human  controller  remnant  and 
Involve  injection  of  wide-band  noise  into  the  system.  This  noise  is  "filtered" 
by  the  other  processes  in  the  pilot  model  and  by  the  system  dynamics.  It  should 
be  emphasized  that  the  injected  remnant  is  a legitimate  (if  unwanted)  part  of 
the  pilot's  input  to  the  system  and,  therefore,  significant  amounts  of  remnant 
power  should  not  be  filtered  out  in  the  de-aliasing  process  of  a valid 
simulation. 

The  neuro-motor  lag  matrix  limits  the  bandwidth  of  the  model  response. 
Typically,  for  wide-band  control  tasks,  Involving  a single  control  variable,  a 
bandwidth  limitation  of  about  10-12  rad/sec  gives  a good  match  to  experimental 
results  (l.e.,  a neuro-motor  time  constant  of  T^  £ .08  - .10).  For  many 
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aircraft  control  tasks  there  is  no  significant  gain  (i.e. » reduction  in  error) 
to  be  obtained  by  operating  at  this  bandwidth,  and  there  can  be  some  penalty  in 
unnecessary  control  activity.  For  such  tasks  larger  time  constants  (lower 
bandwidths)  have  been  observed.  In  these  cases,  if  the  neuro>motor  time 
constant  is  arbitrarily  set  at  the  human's  limit  (say  T{]  « .1)  good  predictions 
of  tracking  or  regulation  performance  are  usually  obtained;  but  the  control 
activity  and  pilot  bandwidth  tend  to  be  overestimated.  Inasmuch  as  it  may  be 
useful  to  have  more  accurate  estimates  of  pilot  bandwidth  for  making  decisions 
concerning  approximations  to  the  discrete  simulations,  Th  was  chosen  in  this 
study  on  the  basis  of  a model  analysis  of  the  tradeoff  between  error  and 
control-rate  scores.  Essentially,  this  involves  using  the  model  to  sweep  out  a 
curve  of  error-score  versus  control-rate  score  to  find  the  value  of  »rtiere 
marginal  improvements  in  performance  require  substantial  increases  in  rms 
control-rate  (the  "knee"  of  the  curve).  A value  of  approximately  .15  sec  (an 
operator  bandwidth  of  about  1 Hz)  was  determined  on  the  basis  of  this  analysis.^ 

The  optimal  estimator,  predictor  and  gain  matrix  represent  the  set  of 
"adjustments"  or  "adaptations"  by  which  the  human  attempts  to  optimize 
performance.  The  general  expressions  for  these  model  elements  depend  on  the 
system  and  task  and  are  determined  by  solving  an  appropriate  optimization 
problem  according  to  well-defined  rules.  Of  special  interest  here  is  that,  in 
the  basic  continuous  OCM,  the  estimator  and  predictor  contain  "internal  models" 
of  the  system  to  be  controlled  and  the  control  gains  are  computed  based  on 
knowledge  of  system  dynamics.  The  assumption  is  that  the  operator  learns  these 
dynamics  during  training.* 

The  question  arises  as  to  the  appropriate  internal  model  when  the  human 
controls  a discrete  simulation  of  a nominally  continuous  system.  It  would 
appear  that  if  the  operator  is  trained  on  the  simulation,  then  the  appropriate 
model  corresponds  to  the  simulation  model.**  This  will  be  the  assumption 
employed  with  the  continuous  model. 

Finally,  it  should  be  mentioned  that  the  solution  to  the  aforementioned 
optimization  problem  yields  predictions  of  the  complete  closed-loop  performance 
statistics  of  the  system.  Predictions  of  pilot  describing  functions  and  control 
and  error  spectra  are  also  available.  All  statistical  computations  are 
performed  using  covariance  propagation  methods,  thus  avoiding  costly  Monte  Carlo 
simulations.  This  is  not  the  case  for  the  hybrid  model  described  later. 


*Thls  is  generally  more  convenient  than  assuming  that  the  external  model  differs 
from  the  true  model  and  also  leads  to  good  performance  prediction. ^ 

**lf  the  simulation  model  is  poor,  a control  strategy  that  Is  Inappropriate  for 
the  actual  system  could  be  learned  with  negative  results  in,  say,  transfer  of 
training.  This  issue  can  be  addressed  with  the  hybrid  model  described  later. 


117 


0.2  0pen<4iOop  Siaulator  Ojiiaaflcs 


' The  application  of  the  standard  OCM  to  closed-loop  analysis  requires  a 
continuous  state  representation  of  the  complete  controlled  element.  Since  the 
human  pilot  in  closed  loop  control  will  operate  on  essentially  continuous 
dUtputs  to  generate  continuous  control  Inputs  even  when  digital  computers  are 
Used  in  the  aircraft  simulation,  it  is  meaningful  to  consider  a continuous 
transfer  function  approximation  to  the  open  loop  simulation  dynamics.  Such  an 
approximation  is  developed  here.  It  consists  of  a rational  transfer  fuitction 
multiplied  by  a transportation  lag.  The  rational  transfer  function  approximates 
the  amplitude  distortions  introduced  by  discrete  integration  of  the  flight 
dynamics.  The  delay  accounts  for  all  the  phase  lags  introduced  by  the  adulator 
components.  These  phase  lags  are  the  major  source  of  degraded  performance  and 
increased  workload  in  closed  loop  tasks.  However,  the  amplitude  distortions  can 
be  significant  for  open- loop  responses. 

Astern  Function  From  Stick  Input  to  Displayed  Output 

Figure  3 is  an  elaborated  diagram  of  the  simulator  portion  of  Figure  1. 
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Figure  3.  Open  Loop  Simulator  Dynamics 

Note  that  the  output  of  the  visual  servo,  y(t),  is  a continuous  signal  as  is  the 
input,  u(t),  to  the  A-0  dealiasing  pre- filter.*  For  analysis  purposes  we  use  the 
notation  implied  in  Figure  3.  Variables  or  functions  with  argument  s represent 
Laplace  transforms  and  those  with  argument  z correspond  to  z- transforms.  The 
starred  quantities  correspond  to  Laplace  transforms  of  impulse  sampled  signals 
or  of  functions  of  z and  are  defined,  e.g.,  by 7 

*(s)  ^ Uj(2) I * u,(s+jnn) 

* 2=e  \* 


or 


*For  simplicity,  we  consider  single- input,  single-output  systems.  The  results 
obtained  here  can  be  generalized  to  more  complex  situations. 
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D*(S)  = D(z) 


(3) 


where  T is  the  sample  period  and 
ft  = — ^ = sampling  frequency 


From  Figure  3#  obtain 


y(s)  = F2(s)yj^*(s)  = F2(s)D*(s)Uj^*(s) 

1 * 

= F2(s)D*(s)  i I Pi(s+jnft)u(s+jnft) 


n=-« 


(4) 


Equation  (5)  gives  the  exact  transfer  relation  between  u(s)  and  y(s). 
However » it  is  not  a useful  expression  from  the  standpoint  of  closed- loop 
modeling  because  of  the  infinite  summation. 

The  system  function  for  a linear  system  (such  as  the  simulation  system 
under  analysis)  may  be  obtained  by  computing  the  steady-state  response  of  the 
system  to  an  input  of  the  form  exp(st).  It  is  shown  in  Reference  5 that  the 
system  function  from  u(s)  to  y(s)  (in  steady-state)  is  periodic  in  time  with  a 
period  equal  to  the  sampling  period.  However,  if  the  output  y(t)  is  considered 
only  at  sampliim  instants,  which  amounts  to  introducing  a "fictitious"  sampler 
at  the  output'  then  the  following  time- independent  transfer  function  is 
obtained . 


G(s;t) 


sample 

times 


G(s)  * P2*(s)D*(s)Pj(s) 


(6) 


We  shall  consider  G(s)  defined  in  (6)  to  be  the  "exact"  transfer  function  for 
the  simulation.  Note  that  F2*(s)  = (VHi)*(s), 

Equation  (6)  is  intractable  for  use  with  the  continuous  OCH.  Therefore,  it 
will  be  necessary  to  approximate  (6)  for  closed- loop  analysis.  A 
straightforward  approximation  is  to  ignore  all  but  the  nsO  term  in  the 
expression  for  F^,*  vAiich  results  in 
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(7) 


G(s)  - F3(s)DMs)F3^(s) 

T 


V(s)H£<s)D*(J5)Fj^(s) 

T ~ 


In  utilizing  (7)  it  will  be  necessary  to  approximate  D*(s);  the  procedure  for 
doing  this  will  be  discussed  subsequently. 

For  the  simulator  of  Interest  here,®  the  transfer  functions  for  the 
de-aliasing  filter  and  servo  are,  respectively, 


c 


F-  (s)  = 2 2 3~ 


(8) 


u)^2 

V(s)  = J 


(9) 


The  hold  transfer  function  is  either 


H„(S) 


s 


(10) 


or 


H(s) 


s T(1+Ts) 


(11) 


Sample  periods,  T,  of  1/32,  1/16,  1/10  will  be  considered  as  these  cover 
the  likely  range  of  interest  for  piloted  simulation.  Therefore,  if  the  cutoff 
of  the  de-aliasing  filter  is  chosen  on  the  basis  of  the  sampling  theorem,*)^  > 
5Hz.  The  visual  servo  dynamics  of  interest  are  characterized  by<^  s 25  rad/seo 
and  J a .707.® 

With  these  parameter  values,  each  of  the  transfer  functions  of  (8)  - (11) 
may  be  approximated  reasonably  well  by  a pure  transport  lag  in  the  frequency 
region  of  interest  for  manual  control  (<^<  10  rad/see).  That  is. 
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where 


P^(S) 

2? 

e“^F® 

V(s) 

e"V 

(12) 

Ho(s) 

e o 

H^O) 

2 _ 

2T 

ir 

Tq  = T/2 

(!;%)“ 

1 ^ 

.057  sec 

» T 

(13) 

Substitution  of  (12)  into  (7)  yields 

Fj^(s)D*(s)F2(s)  D*(s)  exp  -j(Tp  + Ty  + T^)sj  (1M) 

where  i s 0 or  1 for  the  zero-order  or  first-order  hold,  respectively. 


2.3  Effects  of  Discrete  Integration 

In  the  previous  section  the  transfer  function  D*(s)  was  left  unspecified  as 
was  the  Banner  in  which-  it  was  to  be  approximated  for  continuous  closed-loop 
analysis  with  the  OCM.  In  general,  D*(s)  will  be  a "distorted"  version  of  the 
continuous  syst«a  dynaafios  that  are  to  be  simulated.  Some  general  features  of 
the  distortions  introduced  by  various  integration  schemes  are  analyzed  and 
presented  in  Reference  5 along  with  results  pertinent  to  the  F-8  dynamics  that 
are  to  be  analyzed  later.  Here,  we  present  a brief  discussion  of  the  general 
effects  of  discrete  integration  followed  by  a description  of  the  method  that 
will  be  used  to  approximate  D*(s)  in  the  continuous  closed-loop  analysis. 

Consider  the  continuous  vehicle-dynamics  as  described  in  the  state-variable 
form  of  Equation  ( 1) . For'  constant  system  matrices , the  transfer  matrix  between 
system  outputs  and  control  inputs  is  given  by 

y(s)  * l^(s)  u(s) 


i,(s)  = Cc(sI-Ic)'^Bo  + D<j 

When  equations  (1)  are  "integrated"  digitally,  they  lead  to  a discrete 
approximation  with  the  following  transfer  matrix^ 


D*(s)  = {c^(zI-A^l 


-I 


z-e 


sT 


(16) 
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where  the  natrioes  in  (16)  depend  on  the  particular  integration  aoheme  and 
sa&ple  period  as  well  as  on  the  corresponding  continuous  system  matrices. 
Several  points  concerning  Equation  (16)  are  noteworthy.  First,  the  elements  of 
the  discrete  transfer  matrix  D*(s),  cannot,  in  general,  be  expressed  as  the 
ratio  of  two  polynomials  in  s of  finite  degree.  Second,  the  Bode  responses 
corresponding  to  (16)  will  differ  from  the  continuous  responses  in  both 
amplitude  and  phase;  and,  further,  the  responses  for  the  discrete  system  are 
periodic  in  frequency  with  period  equal  to  27r/T  . Third,  the 

poles  and  zeros  of  Equation  (16)  are  infinite  in  number  and  are  given  by,  for 
example. 


?!  * + j (Wj^  + 2irk)  ? k = 0,  +1,  +2,... 


Moreover,  the  principal  values  for  the  poles  and  zeros,  i.e.,  those  with  k s Q, 
are  not,  in  general,  equal  to  the  corresponding  poles  and  zeros  of  the 
continuous  system.  Finally,  simple  integration  schemes,  such  as  Euler,  will 
have  the  same  number  of  principal  poles  as  the  continuous  system,  whereas 
multi-step  Integration  schemes,  like  (Adams-Bashforth) , will  introduce  principal 
roots  that  are  spurious. 

We  now  turn  to  the  problem  of  approximating  D*(s)  so  that  the  continuous 
representation  of  the  simulator  dynamics  may  be  completed.  Because  of  the 
restrictions  imposed  by  the  OCM,  we  restrict  the  possible  approximations  to  the 
following  form: 


D*..(S)  D.j(s) 


-VS 


where  K(s)  is  a ratio  of  finite  polynomials  in  s with  numerator  degree  less  than 
or  equal  to  the  degree  of  the  denominator.  Note  that  the  same  "ccmputation" 
delay,  *C  c associated  with  each  transfer  function.  This  turns  out  to  be  a 
good  approximation  for  the  dynamics  considered  in  §^ction  <(.  If  different 
delays  were  needed,  they  would  be  Included  in  0 via  a rational  Fade 
approximation.^ 


The  simplest  approach  to  selecting  D is  to  use  (15)  and  let 


D^j(S)  « (g)  (17) 

ij 

From  the  standpoint  of  the  OCH,  this  means  that  the  state  equations  for  the 
original  dynamics  are  used  and  discrete  integration  is  modeled  by  adding  a delay 
determined  from  the  phase  distortion.  As  has  been  stated  earlier,  such  an 
approximation  probably  accounts  for  the  major  source  of  difficulty  of  discrete 
Integration  in  closed-loop  control.  However,  to  employ  it  exclusively  is  to 
leave  us  somewhat  uncertain  as  to  the  closed-loop  significance  of  the  amplitude 
distortions. 
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It  was  found^  that  very  good  approximations  to  discrete  Bode  responses 
could  be  obtained  for  the  longitudinal  control  tasks  that  are  to  be  analyzed 
later.  These  approximations  involved  perturbation  of  aircraft  stability 
derivatives  and  CAS  parameters  to  yield  continuous  modes  that  agreed  with  the. 
discrete  modes.  In  the  case  of  A-B  Integration,  it  was  also  necessary  to 
introduce  a zero  in  the  continuous  vehicle  transfer  in  order  to  reproduce  the 
amplitude  distortion  introduced  by  this  integration  scheme. 

When  Equation  (17)  is  substituted  in  (14),  the  basic  result  is  that  for  the 
frequency  range  likely  to  be  of  interest  in  continuous  aircraft  control 
problems,  the  simulator  transfer  function  can  be  modelled  as 


Z(8) 

u(s) 


D(s)e'‘^8® 


(18) 


where  D(s)  in  an  "approximation"  to  the  Bode  response  for  digital  integration  of 
the  vehicle  dynamics.  The  simulator  delay,  is  given  by 


s 


(19) 


where  Tp,  Sg, t y and  respectively,  are  the  delays  introduced  by  the 
de*aliasing  filter,  hold,  visual  servo  and  CPU  (discrete  integration). 

The  approximation  of  Equation  (18)  readily  lends  itself  to  efficient 
application  of  tljg  OCN.  The  system  matrices  corresponding  to  a state 
representation  of  D and  the  values  forT^  are  easily  obtained  for  different 
smaple  periods,  etc.  For  each  condition,  a single  run  of  the  OCM  is  sufficient 
to  predict  the  corresponding  performance.  Adjustment  of  pilot  parameters, 
specifically  observation  noise  levels,  allows  the  sensitivity  to  pilot  attention 
to  be  examined. 9 


3.  TUB  HYBRID  NQOBL 

There  are  shortcomings  in  the  continuous  model.  For  exmple,  the  effects 
of  aliasing  are  not  considered.  Thus,  the  degrading  effects  of  the  de*allasing 
filter  are  included  in  the  continuous  model  but  not  its  benefits.  This  means 
that  decreasing  the  bandwidth,  (0  q,  of  that  filter  can  only  lead  to  negative 
results,  a situation  that  is  not  obviously  true,  in  general.  Similarly,  because 
only  the  delays  inherent  in  the  data  holds  are  considered,  zero>order  holds  will 
always  show  less  degradation  than  first-order  holds.  But,  in  some  instances, 
the  first  order  hold .may  provide  advantages  that  outweigh  the  additional  delay 
penalty.  This  type  of  trade-off  oaiuiot  be  explored  with  the  continuous  OCH 
without  more  sophisticated  approximation  to  the  simulator  dynamics.  Because  of 
these  and  other  potential  shortcomings,  it  was  decided  to  develop  a hybrid 
model. 
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The  approach  to  developing  the  hybrid  model  is  to  "simulate"  the 
olosed«loop  simulation,  A discrete  simulation  version  of  the  OCM^^  was  used  in 
a closed-loop  digital  Monte  Carlo  type  computation*  in  which  "continuous" 
elements  of  the  loop  are  updated  at  a rate  significantly  greater  than  discrete 
elements.  In  other  words,  the  hybrid  model  is  a multi-rate  sampling  syston, 
rather  than  a true  hybrid  system,  (Informal  experimentation  indicates  that  a 
sample  rate  five  times  that  of  the  discrete  elements  is  adequate  to  simulate 
continuity  for  the  cases  considered  here.)  In  addition,  to  different  sample 
rates  for  continuous  and  discrete  elements,  the  updating  of  the  discrete 
equations  of  the  hybrid  model  is  different  for  the  two  kinds  of  elements.  In 
particular,  discrete  el«sents  are  updated  by  means  of  the  integration  scheme  and 
time-step  specified  for  the  "true"  simulation.  The  equations  for  continuous 
elements  are  updated  at  the  faster  rate  via  transition  matrix  methods. 

The  equations  describing  the  hybrid  model  are  quite  complex  and  are 
described  in  detail  in  Reference  5.  Here,  we  simply  note  two  features  of  the 
model  that  are  interesting  and  useful  in  subsequent  analyses.  First,  the  hybrid 
model  was  implemented  so  that  the  prediction  time  in  the  predictor  of  the  OCM 
(See  Figure  2)  could  be  selected  arbitrarily.  This  contrasts  with  the  standard 
OCM  in  which  the  prediction  time  is  always  equal  to  the  time  delay.  This 
additional  freedom  allows  us  to  "sweep  out"  curves  of  performance  versus 
prediction  time.  Theoretically,  best  performance  should  be  obtained  when  the 
prediction  time  is  equal  to  the  sum  of  the  human’s  delay  and  the  simulator’s 
delay,  i.e.  when  the  operator  compensates  optimally  for  both  delays.  Since  the 
human’s  delay  is  an  assumed  parameter,  the  compensation  time  for  best 
performance  yields  an  independent  measure  of  the  simulator  delay. 

A second  feature  of  the  hybrid  model  is  that  the  internal  model  for  the  OCM 
need  not  be  the  same  as  the  system  model.*  This  flexibility  provides  the  hybrid 
model  with  a capability  for  examining  transfer-of-training  questions.  In 
addition,  since  optimal  performance  should  correspond  to  the  operator’s  model 
being  equivalent  to  the  system  model,  the  hybrid  model  can  be  used  to  evaluate 
different  (internal)  approximations  to  the  discrete  simulation. 

A final  point  concerning  the  hybrid  model  is  worth  noting.  Because  it  is  a 
Monte  Carlo  model,  it  normally  will  require  many  computer  solutions  to  obtain 
meaningful  statistics.  In  the  analyses  to  be  performed  here,  however,  we  are 
Interested  in  the  steady-state  response  of  stationary  systems.  Rather  than 
average  over  many  Monte  Carlo  solutions,  we  have  assumed  ergodioity  of  the 
processes  and  utilized  time-averaging  of  a single  response.  Even  with  this 
simplifioation,  it  is  fairly  expensive  computationally  to  obtain  valid 
statistical  results. 3 


*A  truly  hybrid  (analog/digital)  model  is  possible  but  would  require  a hybrid 
computer  (which  tras  not  available). 

*Indeed,  the  system  model  can  even  be  nonlinear. 
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4.  AH  EXAMPLE 


The  models  for  closed-loop  analysis  of  simulator  effects  have  been  applied 
to  an  **example*  simulation  involving  air-to-air  target  tracking.  Results  have 
been  obtained  for  both  longitudinal  and  lateral  control  tasks,  for  augmented  and 
unaugmented  dynamics  and  for  different  target  motions.  In  addition,  the  effects 
of  changes  in  design  parameters  of  each  simulation  component  have  been  explored. 
The  full  range  of  results  may  be  found  in  Reference  5.  Here,  a sample  of  the 
results  is  presented  to  shov  the  extent  of  the  simulation  effects  and  the 
capabilities  of  the  closed- loop  models. 

4.1  The  Tracking  Problem 

Figure  4 shows  the  geometry  of  the  air-to-air  tracking  in  the  longitudinal 
plane.  The  gunsight  is  assumed  to  be  fixed  and  aligned  with  the  aircraft  body 
axis.  For  longitudinal  tracking,  we  will  assume  that  no  information  concerning 
the  target's  pitch  angle,  # nor  the  relative  aspect  angle  is  available.  The 
pilot's  task  is  assumed  to  be  that  of  minimizing  the  mean- squared , line-of-sigitt 
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Figure  4,  Target  Geometry 


tracking  error 4y. 

The  target  is  assumed  to  execute  random  vertical  evasive  maneuvers,  in 
particular,  target  altitude  variations  are  generated  by  passing  white,  gausslan 
noise  through  a third  order  filter  as  Illustrated  below. 
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By  seleoting  the  covarUnce  of  the  white  noiae  and  the  cutoff  frequency  of  the 
Butterworth  filter,  raa  altitude  variations  and  noraal  accelerations  aay  be 
specified.  Here,  a cutoff  frequency  of  ^ » .5  rad/sec  was  used  and  the  noise 
covariance  was  chosen  to  give  an  ms  altitude  variation  of  2 $7  ft.  and  an  ms 
acceleration  of  3*1  8<  Of  course,  the  linearity  oi  the  problem  allows  us  to 
scale  the  results  to  correspond  to  higher  or  lower  accelerations. 

The  longitudinal  short-period  dynamics  of  the  P8  without  augmentation  will 
be  the  baseline  dynamics.  The  relevant  equations  may  be  found  in  Beference  5. 
The  short  period  dynamics  have  a natural  frequency  of  2.28  rad/seo  and  a damping 
coefficient  of  .29;  this  represents  poor  short  period  handling  qualities.* 
Because  of  this,  and  because  we  are  interested  In  the  effects  of  simulation 
parameters  as  a function  aircraft  dynamics,  a set  of  augmented  longitudinal 
dynamics  will  also  be  considered.  A pitch  command  augmentation  system  (CAS)  is 
used  to  modify  the  base  airframe  characteristics.  The  CAS  design  is  a modified 
version  of  the  design  proposed  in  Reference  11. 

The  equations  for  the  aupiented  dynamics  are  given  in  Reference  5.  The  P8 
with  the  pitch  CAS  has  short  period  roots  with  a natural  frequency  of  2.78 
rad/seo  and  a draping  coefficient  of  .64;  this  constitutes  a significant 
improvement  in  the  short  period  handling  qualities.^ 


5.  NOOBL  RSSULTS 


5.1  Continuous  Model 

The  continuous  model  was  used  to  analyze  the  effects  of  both  simulation 
parameters  and  problem  variables.  Vith  respect  to  the  simulation,  the  effects 
of  sample  peri^  and  integration  scheme  are  presented  for  the  longitudinal 
CAS-OFF  dynamics.  Problem  dependent  effects  are  illustrated  by  comparing 
CAS-OFF  and  CAS-ON  results. 

Vie  define  a basic  simulation  configuration,  corresponding  to  Figure  3,  in 
which  the  cutoff  of  the  de-aliasing  filter  is  set  at  half  the  sample  frequency, 
the  visual  servo  has  the  DMS  characteristics  ($*  .707,*^n  « 25  rad/sec),  and  a 
zero-order  hold  is  used  in  data  reconstruction. 
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Figure  5.  Effect  of  Discrete  Simulation  on  Normalized  Performance 

Figure  5 gives  normalized  performance  for  the  basic  configuration  as  a 
function  of  sample  period  and  integration  scheme.  Normalized  performance  is 
defined  as  the  tracking  error  obtained  for  the  simulation  configuration  divided 
by  the  tracking  error  that  would  be  obtained  in  a continuous  simulation  with  no 
delays  (or  in  flight).*  The  normalization  is  determined  by  computing  the 
performance  utilizing  the  original,  continuous  state  equations  and  assuming  the 
only  delay  is  that  of  the  operator  (.2  seconds). 

Figure  5 shows  substantial  effects  are  introduced  by  the  simulation, 
particularly  at  low  sample  rates.  Even  for  the  highest  sample  rate  (T  « 
.0312?},  there  is  a 1^20  percent  performance  degradation.  A change  of  this 
magnitude  exceeds  the  normal  Intra*  and  inter-subjeot  variability  in  manual 
tracking  tasks  and  would,  therefore,  be  expected  to  be  significant.  For  the 
lowest  sample  rates  the  performance  degradation  ranges  from  35-30  percent, 
numbers  that  are  clearly  consequential.  It  is  clear  that,  from  a closed-loop 
tracking  standpoint,  A-B  Integration  is  superior  to  Euler  integration. 

The  results  in  Figure  5 assume  that  the  only  adjustments  in  pilot  strategy 
resulting  from  the  simulation  are  an  increase  in  prediction  time  to  compensate 
for  simulator  delays  and  the  adoption  of  an  internal  model  that  accounts  for  the 
amplitude  distortions  (and  pole  perturbations)  introduced  by  the  CPU.  The 
results  are  based  on  the  assumption  of  a fixed  level  of  attention  throughout. 
However,  the  pilot  may  choose  to  devote  more  attention  to  the  task  (work  harder) 
and,  thereby,  reduce  tracking  error.  A reasonable  question  to  ask,  then,  is 
"How  much  more  attention  to  the  task  would  be  required  to  achieve  performance 
levels  comparable  to  those  that  could  be  obtained  in  a continuous  simulationT” 
This  question  can  be  addressed  using  the  model  for  workload  associated  with  the 
OCH.9  The  result  of  this  analysis  is  shown  in  Figure  6. 


*As  might  be  the  case  in  an  all  analog  simulation  with  analog  displays  providing 
undelayed  visual  Information. 
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Figure  6<  Simulation  Workload  Penalty 

It  can  be  seen  from  Figure  6 that  to  achieve  the  performance  equivalent  to 
that  for  continuous  simulation,  the  pilot  would  have  to  increase  his  attentional 
workload  by  factors  up  to  three  for  the  conditions  considered.  There  is  a 
substantial  workload  penalty  and  it  might  be  expected  that  a compromise  between 
performance  degradation  and  increased  workload  might  evolve.  This  would  be  the 
case,  especially  if  the  pilot  had  not  flown  the  vehicle  or  a continuous 
simulator  in  the  same  task  so  that  there  would  be  no  basis  for  setting  a 
criterion  level  of  performance. 

Before  leaving  the  workload  question,  a further  point  is  worth  noting.  In 
the  describing  function  literature,  it  has  been  common  practice  to  associate 
workload  with  the  generation  of  lead.  However,  there  has  been  no  quantitative 
connection  between  the  amount  of  lead  and  the  increase  in  workload.  In  the 
present  context,  one  can  think  of  the  increased  prediction  time  necessary  to 
compensate  for  simulator  delays  as  imposing  a ( processing)  workload  analogous  to 
that  of  lead  generation.  The  measure  of  attentional  workload  given  previously 
may  then  be  thought  of  as  an  alternative  means  of  quantifying  the  workload 
imposed  by  the  requirement  for  additional  prediction. 

It  was  anticipated  that  there  would  be  an  interaction  between  the  effects 
of  simulation  parameters  and  problem  variables  such  as  vehicle  handling 
qualities.  Thus,  the  above  tracking  task  was  analyzed  for  the  CAS/ON 
configuration. 

Figure  7 compares  normalized  longitudinal  CAS-ON  and  CAS-OFF  performance 
for  the  basic  simulation.  It  can  be  seen  that  the  CAS-ON  performance  is 
degraded  more  by  the  discrete  simulation  than  the  CAS-OFF  performance.  These 
results  are  explained  by  the  fact  that  the  delays  introduced  by  digital 
integration  are  larger  for  CAS-ON  dynamics  than  they  are  for  CAS-OFF  dynamics. 
The  effects  of  longitudinal  dynamics  when  viewed  in  terms  of  absolute 
performance  are  interesting  and  are  also  shown  in  Figure  7.  The  absolute 
performance  for  continuous  simulation  is  better  for  CAS-ON  than  CAS-OFF  (by 
about  3.5  percent)  and  the  sensitivity  to  incremental  computation  delay  is  about 
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Figure  7.  Effect  of  Vehicle  Dynamics 

the  same  for  the  two  configurations.  Thus,  for  a given  simulation 
configuration,  absolute  performance  for  CAS-ON  and  CAS-OFF  configurations  will 
be  about  the  same  if  Euler  Integration  is  used  and  the  CAS-OFF  configuration  can 
give  better  performance  if  A-B  integration  is  used.  In  other  words,  the 
discrete  simulation  washes  out  any  improvement  due  to  the  CASI 
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5.2  Hybrid  Model 


The  hybrid  model  was  used  to  investigate  several  issues  that  could  not  be 
examined  readily  in  the  continuous  model  context.  Results  were  limited  to  the 
longitudinal  unaugmented  dynamics  because  of  cost  and  time  considerations 


DELAY  COMPENSATION  (mc) 


Figure  8.  Effect  of  Operator  Prediction  Time 

Figure  8 shows  the  sensitivity  of  performance  to  delay  compensation  time* 
for  the  basic  simulation  configurations  with  both  Euler  and  A*B  integration  and 


*The  prediction  time  in  excess  of  that  needed  to  compensate  for  the  operator's 
intrinsic  delay  of  .2  sec. 
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for  T = .1  and  T * ,0625.  The  "internal"  models  for  the  OCM  in  these  cases  are 
the  continuous  approximations  to  the  discrete  transfers  that  incorporate 
amplitude  distortion  effects;  however^  no  delay  is  added  to  the  human's  delay 
of  .2  seconds  to  account  for  the  simulations  delays.  Thus,  we  expect  the 
optimal  prediction  times  to  be  approximately  equal  to  the  delay  Introduced  by 
the  simulation.  This  is  indeed  the  case  as  can  be  seen  in  Figure  8,  For  Euler 
integration  the  minima  occur  at  ~.26  sec  and  "’.2  sec.  for  T = ,1  and  ,0625* 
respectively;  the  corresponding  simulation  delays  are  .27  and  .19  . 

For  A-B  Integration  the  minima  are  at  larger  compensation  times  than  for 
Euler.  This  is  a result  of  the  method  used  to  account  for  amplitude  distortion. 
(Recall  that  a zero  was  introduced  in  the  transfer  function  and  this 
necessitated  an  increased  transport  delay  to  match  the  phase  lag  at 
mid- frequencies.)  With  T = .1,  the  optimal  prediction  time  is  around  .3  seconds 
and  the  simulation  delay  is  ~.32  seconds.  For  T = .0625»  performance  does  not 
appear  to  be  very  sensitive  to  prediction  time  in  the  neighborhood  of  the 
optimum.  The  simulation  delay  is  *’.21  seconds  and  performance  for  this 
prediction  time  is  indistinguishable  from  optimal  performance.  Figure  8 also 
shows  a curve  for  the  case  where  the  operator's  internal  model  does  not  include 
a zero  to  match  the  amplitude  distortion  of  A-B  integration.  It  can  be  seen 
that  for  this  case  a delay  compensation  of  only  ".17  seconds  is  required.  This 
corresponds  to  the  delays  introduced  by  the  servo,  pre- filter  and  zero-order 
hold.  The  optimal  performance  is  marginally  poorer  than  for  the  case  with 
amplitude  distortion  included  in  the  internal  model.  These  results  suggest  that 
although  inoludlng  the  zero  provides  a better  model  of  the  effect  of  A-B 
integration,  the  increased  delay  compensation  needed  to  offset  the  extra  lead 
should  not  be  viewed  here  as  a workload  penalty. 

These  results  confirm  the  estimates  of  simulation  delay  used  in  the 
continuous  model.  They  also  demonstrate  Implicitly  how  operators  may  adapt 
their  behavior  to  compensate  for  simulator  Inadequacy.  The  added  prediction 
required  may  Impose  a workload  penalty  as  noted  earlier. 

Another  form  of  adaptation  to  the  simulation  involves  the  pilots  internal 
model.  Two  questions  are  of  interest;  1.)  What  model  will  the  trained  operator 
adopt  when  "flying"  the  simulator?;  and  2.)  What  is  the  "transfer"  effect  of  a 
wrong  model  when  transitioning  from  discrete  simulator  to  continuous  simulator 
(flight)?  At  least  partial  answers  to  these  questions  for  the  longitudinal 
dynamics  and  Euler  integration  are  provided  by  the  results  shown  in  Figure  9. 

Figure  9 gives  performance  vs.  delay  compensation  for  T s ,1  and  two 
internal  models.  One  Internal  model  is  that  derived  to  match  the  corresponding 
discrete  transfer  function  while  the  other  is  the  basic  continuous  model.  It 
can  be  seen  that  better  performance  is  obtained  when  the  Internal  model 
corresponds  to  the  approximate  discrete  model  implying  that  this  is  a better 
model  of  the  discrete  simulation  than  is  the  original  continuous  model.  Figure 
9 also  shows  the  effect  of  using  the  model  corresponding  to  T s .1  seconds  in  a 
simulation  where  the  actual  sample  period  is  .03125  seconds  (i.e.,  nearly 
continuous)  as  oompared  to  using  the  model  for  T a .03125  seconds  (i.e.,  the 
correct  one).  If  the  operator  optimizes  delay  compensation,  performance  will  be 
degraded  by  about  10^.  If,  on  the  other  hand,  the  delay  compensation 
appropriate  to  T a .1  is  used,  a performance  penalty  of  about  191(  will  be 
incurred.  The  effect  is  not  substantial  here  but  it  might  be  in  other  tasks. 
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Figure  9.  Effect  of  Internal  Model 

The  effect  of  the  cutoff  frequency  of  the  de^aliasing  filter  on  perfomanoe 
is  shown  in  Figure  10.  Euler  integration  of  the  vehicle  equations  is  used  and 
other  simulation  parameters  correspond  to  the  basic  configuration.  The  results 
are  for  a sample  frequency  of  10  Hz  (T  s .1)  so  a cutoff  frequency  of<^  * 5 Hz 
satisfies  the  Nyquist  requirement.  Results  are  obtained  for^  * 1i  5 and  20 
Hz,  respectively.  The  lowest  value  ottHQ  s 20  Hz  is  based  on  the  assumption 
that  there  is  not  significant  signal  power  beyond  5 Hz  so  there  is  no  need  to 
set  the  filter  break-point  at  that  frequency  and  incur  the  delay  penalty.  The 
results  in  Figure  10  favor  using  the  higher  cutoff  frequency, « 20  Hz,  for 
this  problem.  Furthermore,  there  is  a substantial  penalty  for  using  the  low 
frequency  cutoff.  These  two  results  imply  that  aliasing  is  not  a problem  here. 
We  also  note  that  the  performance  minima  for<^  s 20  Hz  and  5 Hz  occur  at  about 
the  correct  value  of  prediction  time;  the  optimum  prediction  time  for  g s 1 Hz 
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Is  much  larger  but  not  quite  so  large  as  the  estimated  total  simulation  delay  of 


Figure  10.  Effect  of  Dealiasing  Filter  Cutoff  Frequency 


.53  seconds. 

The  effects  of  using  a first  order  hold  instead  of  a zero  order  hold  are 
shorn  in  Figure  11  for  both  Euler  and  A-B  integration  at  T s .1  and  for  Euler 
integration  at  T s .0625.  The  corresponding  best  zero  order  hold  performance 
values  are  also  shown  for  comparison  purposes.  At  a sample  period  of  .1 
seconds,  slightly  lower  tracking  errors  are  obtained  for  Euler  integration  with 
a first  order  hold  than  with  a zero  order  hold;  in  addition,  the  minimum 
performance  is  obtained  with  less  delay  compensation.  The  situation  for  A-B 
integration  and  a .1  second  sample  period  is  the  reverse  of  that  for  Euler. 
That  is,  for  A-B  integration  the  first  order  hold  degrades  performance. 

A possible  explanation  for  these  results  is  as  follows.  The  first  order 
hold  uses  intersample  information  which  provides  some  lead.  For  long  sample 
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DELAY  COMPENSATION  (tec) 


Figure  11.  Effect  of  First  Order  Hold 

periods  and  Euler  integration,  the  effective  lead  provided  is  apparently  more 
beneficial  than  the  lag  penalty  associated  with  the  higher  order  hold.  The 
beneficial  effects  of  a first  order  hold  should  decrease  as  the  sample  period 
decreases.  This  is  supported  by  the  results  for  T * .0625  which  show  no 
difference  between  the  two  holds.  In  the  case  of  A-B  Integration  the  added 
delay  of  the  first  order  hold  dominates.  This  may  be  due  to  A-B  integration 
having  an  implicit  first  order  hold  at  the  input,  thereby  reducing  any  advantage 
in  adding  such  a hold  at  the  output. 
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6.  SUIMARI  AND  CONCLUSIONS 


In  this  paper  we  have  examined  the  effects  of  simulation  parameters  and 
components  on  simulator  fidelity,  particularly  with  regard  to  predicting 
operator  performance  and  workload.  Our  focus  has  been  on  the  dynamical  aspects 
of  simulator  primarily  as  they  relate  to  closed  loop  control.  He  have  generally 
ignored  questions  that  would  necessitate  Inclusion  of  detailed  models  for  cue 
perception  leaving  these  to  future  study. 

An  approximate  continuous  model  of  the  discrete  simulation  was  incorporated 
in  the  standard  optimal  control  model  for  the  human  operator.  The  resulting 
continuous  closed-loop  model  was  used  to  analyze  both  overall  simulation  effects 
and  the  effects  of  Individual  elements.  The  results  showed  that,  as  compared  to 
an  ideal  continuous  simulation,  the  discrete  simulation  could  result  in 
significant  performance  and/or  workload  penalties.  The  magnitude  of  the  effects 
depended  strcngly  on  sample  period  as  expected.  From  a closed-loop  standpoint 
it  seemed  clear  that  A-B  integration  was  much  to  be  preferred.  With  respect  to 
the  other  simulation  components  it  can  be  said  that  any  reduction  in  delay  is 
desirable.  Such  reductions  inevitably  involve  increased  costs  (hardware  or 
software)  which  must  be  balanced  against  the  expected  improvements. 

In  addition  to  the  continuous  model,  a hybrid  model  was  developed  to  allow 
investigation  of  situations  that  could  not  be  treated  adequately  with  the 
continuous  model.  Several  interesting  results  were  obtained  with  this  model. 
It  was  shown  that  for  this  (fairly  typical)  aircraft  control  problem  signal 
bandwidths  were  such  that  the  de-aliasing  filter  cutoff  frequency  could  be  set 
at  a value  greater  than  half  the  sample  frequency.  Also,  there  appeared  to  be  a 
potential  under  certain  conditions  for  improved  simulator  performance  with  a 
first  order  hold  (rather  than  a zero  order  hold).  The  model  was  also  used  to 
show  demonstrable  effects  for  adopting  the  simulator  dynamics  as  an  internal 
mcdel.  The  need  to  compensate  for  simulator  delays  via  added  prediction  was 
also  shown. 

We  believe  the  models  developed  here  can  be  very  useful  in  developing 
engineering  requirements  for  flight  simulators.  These  requirements  will  be 
problem  dependent  which  is  one  reason  why  models  are  needed.  As  we  see  it  now, 
the  process  for  using  the  models  would  involve  the  following  steps: 

i)  Use  standard  OCM  to  analyze  ideal  continuous  simulation  to  develop 
baseline  performance  and  to  determine  expected  signal  bandwidths. 

li)  Analyze  distortion  introduced  by  discrete  integration  schemes  and 
develop  continuous  models  for  discrete  dynamics  valid  over  the  band  of 
interest . 

ill)  Analyze  effects  of  integration,  cue  dynamics  etc.  using  continuous 
model . 

iv)  Use  hybrid  model  to  examine  effects  of  data  reconstruction, 
de-aliasing  cutoff  frequency  etc. 
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Before  this  procedure  could  be  used  with  complete  confidence  the  models 
described  herein  need  further  validation  and  extension.  It  is  especially 
important  to  collect  data  in  a carefully  controlled  experiment  to  verify  the 
individual  simulation  effects. 
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SUMMARY 


Many  useful  oathefflatical  models  for  manual  control  monitoring  and 
aeoisicn-making  tasks  in  man-machine  systems  have  been  designed  and 
successfully  applied.  However^  critical  comments  have  occasionally  been 
made,  mainly  by  practitioners  concerned  with  the  design  of  complex 
man-machine  systems.  They  blame  especially  models  which  seem  to  explain 
only  data  from  abstract  subtask  experiments  designed  particularly  for  these 
models. 

In  this  paper,  an  Initial  approach  to  bridging  the  gap  between  these 
two  points  of  view  is  presented.  From  the  manifold  of  possible  human 
tasks,  a very  popular  baseline  scenario  has  been  chosen,  namely  ear 
criving.  A hierarchy  of  hvaoan  activities  is  derived  by  analyzing  this  task 
in  general  terms.  A structural  description  leads  to  a block  diagram  and  a 
time-sharing  computer  analogy. 

The  range  of  applicability  of  existing  mathematical  models  is 
considered  with  respect  to  the  hierarchy  of  human  activities  in  real 
complex  tasks.  Also,  other  mathematical  tools  so  far  not  often  applied  to 
man-machine  systems  are  discussed.  The  mathematical  descriptions  at  least 
briefly  considered  here  Include  utility,  estimation,  ccntrol,  queueing,  and 
fuzzy  set  theory  as  well  as  artificial  intelligence  techniques.  Some 
thoughts  are  given  as  to  how  these  methods  might  be  Integrated  and  how 
further  work  might  be  pursued  . 
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INTRODUCTION 


kfhen  designing  such  systems  as  autooiobilesi  aircraft,  power  plants, 
and  management  information  systems,  it  is  very  important  to  understand  the 
iMman*s  role  in  the  system  and  design  the  man-machine  interface 
appropriately.  The  engineering  approach,  which  leads  one  to  represent  the 
machine  in  terms  of  differential  equations,  networks,  etc<  suggests  that 
the  human  can  also  be  represented  as  a set  of  mathematical  equations  for 
the  purpose  of  systems  analysis  and  design.  Thus,  considerable  effort  has 
been  devoted  to  developing  mathematical  models  of  human  behavior. 

tesplte  the  criticisms  of  those  who  find  the  analogy  between  humans 
ana  equations  unpalatable,  many  models  have  been  reasonably  successful 
within  the  limited  domains  Uiat  they  addressed*  In  fact,  if  we  accept  the 
premise  that  human  behavior  mainly  reflects  the  external  environment  £l], 
then  it  is  not  surprising  that  man  and  machine  can  be  described  in  similar 
terms.  Quite  slmrly,  since  the  human  adapts  his  behavior  to  the  machine, 
his  actions  become  sometdiat  maohine-like*  (Of  course,  from  a design  point 
of  view,  one  tries  to  avoid  requiring  the  human  to  adapt  to  the  machine  to 
any  extreme  extent.) 

On  the  other  hand,  the  success  of  models  in  limited  domains  has  not 
hac  substantial  impaot  in  realistically  complex  domains,  for  example, 
manual  control  models  are  not  everyday  tools  for  the  aircraft  designer, 
turther,  as  the  reader  will  see  i»nual  control  models  capture  only  a small 
portion  of  the  total  task  of  driving  an  automobile.  For  these  reasons, 
designers  have  been  known  to  claim  that  mathematical  models  of  human 
behavior  are  not  particularly  useAil*  khile  the  authors  cxily  partially 
agree  with  this  opinion,  even  as  it  relates  to  currently  available  models, 
such  statements  have  motivated  the  woHc  upon  which  this  paper  is  based. 

hi thin  this  paper,  the  authors  present  a realistioally  complex  task 
(l*e.}  automobile  driving)  and  illustrate  the  various  aspects  of  the  task 
by  using  written  protocols  of  subjects'  behavior.  A hierarchy  of  hvsaan 
activities  is  derived  by  analyzing  this  task  in  general  terms.  A 
time-sharing  computer  analogy  and  block  diagram  are  presented.  Numerous 
mathematical  methodologies  appropriate  to  representing  such  a model  are 
discussed*  finally  the  state-of-the-art  is  summarized  and  the  prospects 
are  considered « 

A HEALISTIC  TASK 


In  considering  alternative  realistic  task  domains,  the  authors 
discussed  a variety  of  domains  including  aircraft  piloting,  industrial 
process  monitoring,  and  automobile  driving.  After  substantial  dlsousaion, 
It  became  quite  clear  that  the  domain  to  which  both  the  authors  and 
potential  readers  oould  moat  relate  was  sutomoblle  driving. 
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the  ''experinent"  involved  a hypothetical  trip  from  the  driveway  of  one 
author's  house  (GJ)  to  the  hone  of  the  other  author  (WR).  Two  subjects 
participated  (GJ  and  WR).  Their  task  was  to  explain  1q  derail  what  they 
would  be  doing  throughout  he  hypothetical  trip.  Badt  subject 
independently  generated  a written  protocol  of  the  trip.  The  two  resulting 
protocols  were  nerged  to  produce  Figure  1. 

The  activities  in  this  figure  can  be  oategorired  into  several  levels 
of  behavior: 

1.  Reaching,  twisting,  and  listening 

2.  Steering,  accelerating,  and  braking 

3.  Looking  around  and  estimating 

4 . Updating  and  evaluating 

5.  Planning 

6.  Reflecting  and  daydreaming 

The  authors  would  like  to  suggest  that  a theory  of  human  behavior  in 
realistic  tasks  should  be  able  to  model  levels  1 through  5.  In  pursuit  of 
this  possibility,  this  list  was  somewhat  compacted  to  yield  the  following 
aspects  of  behavior  to  be  modeled: 

t.  Sensing  and  interpreting  inputs 

2.  Planning 

3.  Implementing  plans 

To  consider  these  three  topics,  an  overall  framework  will  be  discussed  in 
the  next  section  and  then,  specific  approaches  to  modeling  will  be 
considered  in  the  subsecuent  section. 

STRUCTURAL  DBSCBIPnOH 


Looking  at  the  hierarchy  of  hutmn  activities  discussed  above  as 
information  processing  aotivities,  a time-sharing  computer  analogy  seems  to 
be  a very  appealing  approach  to  understanding  the  structural 
interrelat ionships . 

Figure  2 shows  a sketoh  of  such  a time-sharing  computer  analogy. 
There  are  several  possibilities  for  the  central  nervous  system  (CHS)  to 
interact  with  the  peripheral  input  and  output  devices  (l.e. , the  sensory 
and  the  motor  systems  including  speech  feneration).  The  CHS  is  viewed  as 
being  divided  into  an  operating  system  and  four  classes  of  Jobs,"  i.e., 
program/data  files  (sec,  e.g.,  (2},  (3))*  Hereby,  a multi-processor  system 
allowing  a mixture  of  parallel  and  serial  information  processing  is  most 
likely  to  be  a reasonable  assumption  for  the  human  operator  (4). 

The  operating  system  is  responsible  for  scheduling  the  programs  in  a 
time-sluired  manner  by  using  a priority  interrupt  policy.  Conflicting 
criteria  with  respect  to  priority  have  to  also  be  evaluated  by  the 
operating  system.  This  might  be  a crucial  task,  especially  in  urgent 
situations. 
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Figure  1:  Protocol  for  Typical  City  Trip 
IMSERT  m IH  lONlTION 
PUT  ON  ^AT  E£LT 

PRESS  CAS  PEDAL  TO  FLOOR  AND  ALMOST  TOTALLY  RELEASE 
IbMt  KEI 

LISTEN  FOR  ENGINE  SOUND 
IP  SO,  THEN  GIVE  GAS 
ELSE,  STOP  AND  GO  RACK  TO  TUfM  KEI 
EAIT  FOR  CAR  TO  kARh  UP  « DAYDREAM 

LOOK  AROUND  - SEE  IF  I CAN  BACK  UP  OKAY  . INCLUDES  USING  MIRRORS 
IF  SO,  THEN  PUT  CAR  IN  REVERSE 
ELSE,  WAIT  FOR  ALL  aSAR 
PUT  RIGHT  ARM  ON  SEAT  BACK  SO  AS  TO  SEE  BETTER 
STEER  WITH  LEFT  ARM,  ACCELERATE  AND  BACK  ONTO  STREET 
DETERMINE  WHEN  CLEAR  TO  GO  FORWARD  - STOP  BACKING  UP  > PRESS  BRAKE 
PUT  CAR  IN  DRIVE 

LOOK  AROUND  • SEE  IF  1 CAN  PROCEED 
IF  SO,  ACCELERATE 
ELSE,  WAIT  FOR  ALL  aSAR 

LIMIT  SPEED  SINCE  STOP  SIGN  COMING  UP  - CONTINUE  LOOKING  AROUND 
STEEN  SO  AS  TO  STAY  *SORT  OF*  IN  LANE 

ESTIMATE  DISTANCE  TO  STOP  SIGN  - CHECK  FOR  TIME  TO  DECELERATE 
IP  SO,  REhOVE  FOOT  FROM  GAS  AND  OVER  TO  BRAKE 

ELSE,  UPDATE  ESTIMATE  OP  DISTANCE  - CONTINUE  LOOKING  AROUNO/STBERING 
TUM  ON  Left  DIRECHONAL 

mHEN  fairly  aOSE  to  stop  sign  , PUSH  BRAKE  HARDER  AND  STOP 
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LOOK  LbtT  AND  RlOhT  frOR  TRAFFIC 

IF  NONE  TOO  CLOSE  (ESTIMATE  IF  I CAN  MAKE  IT).  ACCELERATE,  TURN  LEFT 
ELSB|  WAIT  FOR  ALL  CLEAR  AND  CONTINUE  UPDATING  ESTIMATES 
STKAiGhTEN  OUT  SO  AS  TO  KEEP  “sORT  OF'"  IN  LANE 
ACCELERATE,  BUT  NOT  TOO  MUCH  BECAUSE  STOP  SIGN  COMING  UP 
LOOK  AROUND  AT  TRAFFIC  - ALSO  AT  HOUSES  AND  YARDS  - DAYDREAM 
EXECUTE  STOP  SIGN  ROUHNE  > ONE  FOR  STOPPING  - ONE  FOR  STARTING 

• USE  FOUR-WAY  STOP  SIGN  ROUHNB 
execute  ENROUTE  ROUTINE  - INCLUDING  TALKING;  SIGHTSEEING,  ETC. 

• 


PLAN  ROUTE  - WHAT  STREETS  TO  TAKE 


EXECUTE  STOP  SIGN/STOP  LIGHT/TURNING/PASSING/LANB  CHAFING  ROUTINES 


LOCK  AROUND  FOR  APPROPRIATE  PARKING  SPACE 

IF  ONE  FOUND,  DETERMINE  PLAN  FOR  GETTING  INTO  IT 
ELSE,  CONTINUE  LOOKING  - CONTINUE  LOOKING  AROUND  AND  STEERING 
EXECUTE  PLAN  CPEN-LOOP;  WITH  FINAL  UPDATES  AS  ERRORS  CAN  BE  ESTIMATED 
PUT  CAR  IN  PARK 

TUFN  OFF  RADIO  HEATER,  ETC.,  IP  APPROPRIATE 
TURN  OFF  KEY 
REMOVE  KEY 
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Ihe  four  classes  of  progrsm/data  files  relate  to  a central-nervous 
representation  of  tasks  the  human  operator  has  to  perform*  Bach  of  these 
program  classes  is  structured  into  main  programs  and  interrelated 
subroutines  • 


Figure  2:  ^etch  of  a Time-Sharing  Computer 
Model  of  the  Hunan  Operator 


Class  ko*  1 comprises  input-related  programs,  e.g^  human  monitoring 
tasks  and  looking  around  procedures*  Class  No*  2 is  similarly  related  to 
output  activites,  e*g*,  the  structural  organization  of  motion  patterns 
(e.£.,  in  reaching)  and  speech.  Class  No,  3 programs  describe  strict 
input-output  relationships  as  in  tracking-type  control  and  choice -react ion 
tasks.  All  three  classes  contain  programs  with  a high  level  of  autonomy, 
perhaps  carried  out  by  peripheral  processors  * The  operating  system  has  to 
initiate  and  supervise  these  autonomous  processes  • Additionally,  the 
adaptive  control  of  the  sampling  process  in  parallel  tasks  has  to  be 
accomplished  by  the  operating  system  • 

Class  No.  4 represents  the  long-term  memory  of  the  human  which 
includes  a knowledge  base  of  facts,  models,  and  procedures.  The  programs 
of  class  No.  4 are  concerned  with  internal  processes  such  as  reflecting 
and  planning  which  have  access  to  the  knowledge  base^  thereby  occasionally 
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modifying  it«  The  operating  system  is  responsible  for  searching  throu^ 
the  knowledge  base  (see>  e.g.,  [5]}  [3})« 

The  time-sharing  computer  analogy  outlined  here  is  mainly  assumed  as  a 
possible  framewowc  for  future  thinking  about  complex  man-9iadiine  systems. 
To  further  illustrate  the  hierarchical  multi-level  structure  of  human 
activities  within  this  framework,  a block  diagram  is  shown  in  Figure  3* 
Only  the  most  important  information  flows  between  the  different  levels  are 
outlined . 


figure  3?  hierarchical  Multi-Level  Structure  of  Human  Activities 


Lower  level  processes  (bottom  of  Figure  3)  are  normally  characterized 
by  events  occurring  at  a high  frequency  as  compared  to  higher  level 
processes  (top  of  Figure  3)*  This  refers  to  different  time  scales  for 
different  levels.  However*  because  lower  level  processes  may  be 

autonomous*  the  difference  in  time  scales  does  not  mean  that  these 
processes  have  to  be  considered  by  the  operating  system  more  frequently. 

In  Figure  3>  planning  is  denoted  as  a major  activity*  With  data  from 
the  knowledge  base  and  those  from  lower-level  looking  around  procedures^ 
sometimes  influenced  by  higher-level  reflecting*  planning  is  the 
development  of  procedures  to  achieve  overall  goals  and  subgoals  for 
lower-level  processes  • Modifying  the  knowledge  base  as  well  as 
goal-setting  for  controlling  and  reaching  are  shown  as  examples* 
Controlling  itself  is  also  best  described  as  a multi-level  structure*  being 
a subset  of  the  overall  multi-level  structure  of  Figure  3*  Controlling  and 
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reaching  procedures  result  in  output  actions  of  the  human  operator  via 
response  generation  which  refers  to  the  peripheral  output  devices  in  Figure 
2 . Correspondingly,  the  peripheral  input  devices  of  Figure  2 extract 
task-relevant  features  from  sensory  input  information • This  process  is 
very  closely  linked  with  looking  around  procedures  which  are  also  indicated 
in  figure  3. 


MATHEMATICAL  MODELS 
Sensing  and  Interpreting  Inputs 

Reconsidering  the  task  analysis  of  car  driving,  how  does  the  driver 
recognize  stop  signs,  other  cars,  children,  etc?  Could  one,  at  least  in 
theory,  develop  an  algorithm  that  successfully  performs  these  aspects  of 
driving? 


To  pursue  this  question,  the  literature  of  pattern  recognition  and 
artificial  intelligence  was  considered.  Fortunately,  the  literature  in 
these  areas  has  recently  been  summarized  in  the  Systems,  Man,  and 
Cybernetics  Review  [6],  by  Sklansky  [7],  and  in  books  by  Winston  [8],  [91 
for  pattern  reoogniticxi  and  artificial  intelligence  respectively. 

Two  approaches  to  pattern  recognition  have  received  particular 
attention:  statistical  methods  and  syntactical  methods.  The  statistical 

methods  use  discriminant  functions  to  classify  patterns.  This  involves 
extracting  a set  of  features  from  the  pattern  and  statistically  determining 
how  close  this  feature  set  is  to  the  a priori  known  features  of  candidate 
classes  of  patterns.  The  class  whose  features  most  closely  match  the 
measured  features  is  chosen  as  the  match  to  the  pattern  of  interest?  with 
of  course  some  consideratiai  given  to  the  a priori  probabilities  of  each 
class  and  the  costs  of  errors. 

The  syntactic  methods  partition  each  pattern  into  subpattems  or 
pattern  primitives.  It  is  assumed  that  a known  set  of  rules  (a  grammar)  is 
used  to  compose  primitives  into  a pattern.  One  approach  to  recognizing 
primitives  is  to  use  the  statistical  approach  noted  above  . 

Another  aspect  of  pattern  recognition  involves  image  processing, 
here,  each  picture  point  (pixel)  is  classified  according  to  gray  level. 
Then,  thresholds  are  used  to  segment  the  picture.  More  elaborate 
approaches  use  multi-dimensional  classification  of  each  pixel  and  then,  use 
an  appropriate  fault i-dimensional  clustering  of  similar  pixels. 

Artificial  intelligence  researchers  have  devoted  considerable  effort 
to  scene  analysis.  With  emphasis  on  understanding  scenes  composed  of 
somewhat  arbitrary  collections  of  blocks,  methods  have  been  developed  to 
pick  particular  blocks  out  of  scenes,  even  if  the  desired  block  is 
partially  hidden. 

Most  of  the  methods  discussed  above  have  worked  reasonably  well  within 
limited  domains.  When  the  context  within  which  one  is  working  is 
well-understood,  it  is  often  possible  to  successfully  sense  and  interpret 
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inputs)  althou^  considerable  computational  power  may  be  needed  • 

While  the  advent  of  inexpensive  microelectronics  might  allow  one  to 
utilize  large  amounts  of  computational  power  in  a model  of  human  sensing 
and  interpretation  of  data,  there  are  bigger  problems  to  be  solved. 
Namely^  it  is  difficult  to  deal  with  realistic  contexts  in  a static  manner* 
What  a human  sees  depends  on  what  he  is  looking  for,  what  he  expects  to 
see,  and  the  costs  of  not  seeing  it*  These  aspects  of  seeing  cannot  be 
considered  out  of  context  and  without  reference  to  the  specific  individual 
involved . 


Several  investigators  have  considered  the  issue  of  how  the  human 
allocates  his  attention  among  multiple  displays  [10],  [11],  [12],  [13], 
114].  however,  these  models  have  only  been  tested  in  fairly 
well-structured  situations  and  thus,  are  as  yet  unproven  in  realistically 
complex  tasks.  Further^  it  is  by  no  mejuis  obvious  that  these  models  will 
ever  be  able  to  handle  looking  around  in  the  sense  it  appears  in  the 
driving  scenario. 

Thus,  a general  mathematical  theory  of  human  sensing  and  interpreting 
of  inputs  is  far  from  available)  especially  if  one  would  like  to  program 
this  theory  to  drive  a car.  On  the  other  hand,  the  disciplines  of  pattern 
recognition  and  artificial  intelligence  are  beginning  to  succeed  in 
specific  applied  domains  such  as  industrial  inspection  [15],  [16]  and 
medical  diagnosis  [17].  Perhaps  a concatenation  of  specific  successes  will 
lead  to  new  insights  into  the  problems  of  context  and  individual 
differences . 

Planning 

Studying  the  task  analysis  of  car  driving,  it  is  readily  apparent  that 
much  of  the  subjects'  conscious  activities  were  devoted  to  developing, 
initiating,  and  monitoring  plans*  This  observation  agrees  with  analyses  of 
verbal  protocols  in  several  other  task  domains  [1].  In  fact,  one  might 
expect  this  result  within  any  purposeful  activity  for  which  there  are  goals 
as  yet  unfulfilled. 

To  discuss  planning,  one  first  must  emphasize  the  distinction  between 
the  process  of  developing  plans  and  the  process  of  executing  plans  [18]. 
Within  this  section  only  plan  development  will  be  considered,  while  the 
following  section  will  discuss  plan  execution.  One  way  to  Illustrate  the 
difference  between  these  two  activities  is  to  characterize  plan  development 
as  a problem  solving  activity,  while  plan  execution  is  looked  at  as  a 
program  execution  activity  [1]. 

One  develops  a plan  in  hopes  that  its  execution  will  achieve  some 
goals.  While  one  usually  accepts  the  overall  goal  as  given  (e.g.,  land  the 
aircraft),  the  process  of  developing  subgoals  is  often  left  to  the  human. 
The  partitioning  of  goals  into  subgoals  and  then  subgoals  into  lesser 
subgoals,  etc*  reflects  a hierarchical  mode  of  planning  that  has  received 
considerable  attention  [19],  [20]. 
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The  hierarchical  approach  allows  one  to  develop  plans  ttiat  are  broad 
and  sketchy  as  opposed  to  detailed  and  concise*  Thus»  low  level  subgoals 
can  be  temporarily  ignored  until  their  immediacy  demands  attention* 
Similarly)  future  actions  which  require  preconditions  that  are  not  as  yet 
assured  can  perhaps  be  temporarily  ignored  if  one  feels  that  the 
environment  is  hospitable  to  one's  goals  [20]. 

On  the  other  hand,  low  level  subgoals  must  eventually  be  dealt  with. 
Then,  a concise  system  dynamics  model  such  as  Carbonell's  probably  provides 
a reasonable  description  of  human  behavior  [21].  This  model  assumes  that 
the  human  is  dealing  with  a system  describable  by  quantitative  state 
transitions  and  amenable  to  quantitative  control  actions. 

Such  low  level  planning  is  probably  unconscious.  Prom  the  perspective 
of  a computer  analogy,  one  might  say  that  high  level  conscious  planning  is 
like  executing  an  interpreted  program.  (An  interpreted  program  is  one 
where  the  computer  consciously  has  to  interpret  the  meaning  of  each 
statement  as  it  is  executed.)  On  the  other  hand,  low  level  unconscious 
planning  is  similar  to  executing  a compiled  program  [1].  In  fact,  it  might 
be  claimed  that  low  level  planning  cannot  really  be  called  planning. 
Instead,  such  activities  are  only  the  details  of  implementation,  which  are 
discussed  later  in  this  paper. 

Planning  appears  to  include  the  following  aspects: 

1.  Generation  of  alternative  plans, 

2.  Imagining  of  consequences, 

3.  Valuing  of  consequences, 

4.  Choosing  and  initiating  plan, 

5.  Monitoring  plan  execution, 

6.  Debugging  and  updating  plan, 

where  the  latter  three  aspects  deal  with  observing  plan  execution  and 
subsequent  replanning,  but  with  actual  Implementation « 

How  might  one  model  the  generation  of  alternative  plans?  One  can  look 
at  a plan  as  a linked  set  of  subplans  [20].  However,  at  some  level, 
subplans  must  be  specific*  In  many  tasks,  the  alternatives  are  clearly 
defined  »t  the  outset*  On  the  other  hand,  there  are  many  interesting  tasks 
(e.g.,  engineering  design)  where  the  human  must  create  alternatives.  In 
such  oases,  humans  usually  first  consider  alternatives  that  have  been 
successful  in  previous  situations* 

One  might  use  Newell's  pattem<*evoked  production  systems  as  a model  of 
how  the  human  accomplishes  this  search  for  alternatives  [1]*  A production 
is  a rule  consisting  of  a situation  recognition  part  that  is  a list  of 
things  to  watch  for,  and  an  action  part  that  is  a list  of  things  to  do* 
(The  word  "production",  as  it  is  used  here,  has  absolutely  nothing  to  do 
Witt)  the  manufacturing  connotation  of  the  word.) 
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As  an  alternative  to  production  systems^  the  idea  of  scripts  might 
provide  a reasonable  model,  ”a  script  is  a structure  that  describes 
appropriate  sequences  of  events  in  a particular  context  [22] . 

The  ideas  of  production  systems  and  scripts  are  both  related  to  the 
idea  of  the  human  having  an  internal  model.  However,  as  the  reader  will 
see»  it  is  very  different  from  the  type  of  model  assumed  in  the  system 
dynamics  domain,  namely,  productions  and  scripts  provide  forecasts  of 
typical  consequences  rather  than  models  of  internal  state  transitions. 

Sometimes  a new  alternative  is  needed  and  it  is  very  difficult  to  say 
how  a totally  new  idea  is  generated*  Linking  the  idea  of  associative 
memory  [233,  [24]  with  the  idea  of  product iwi  systems  or  scripts,  one  can 
conjecture  that  new  ideas  are  generated  when  the  criterion  for  matching  the 
new  subgoal  with  past  experiences  is  relaxed  and/or  non-standard  features 
of  the  situation  are  emphasized. 

Long-term  plans  that  will  not  be  immediately  implemented  are  probably 
developed  at  the  highest  level  in  the  goal  hierarchy  with  only  major  goals 
coisidered.  buch  a plan  might  be  a sometdiat  vague  verbal  statement  or 
perhaps  a sketch  of  activities  and  relationships.  It  is  interesting  to 
speculate  upon  (and  perhaps  research)  what  plans  look  like  in  the  'mind's 
eye."  ^or  example,  are  plans  list-like  or  are  they  more  spatial,  such  as 
Warfield  s interpretive  structural  models  [25]. 

Short-term  plans  that  will  require  immediate  implementation  cannot  be 
quite  so  sketchy.  In  this  case,  the  human  has  to  consider  specific 
actions.  One  would  probably  be  reasonably  successful  in  modeling  this  type 
of  plan  using  production  systems.  In  this  case,  specific  features  of  the 
environment  would  automatically  evoke  particular  responses.  This  type  of 
behavior  falls  into  the  category  of  class  No.  3 programs  as  defined  in  the 
time-sharing  computer  analogy  introduced  earlier.  Realistic  examples  of 
application  of  this  idea  include  aircraft  attitude  instrument  flying  [26] 
and  air  traffic  control  [2?]. 

Given  a set  of  candidate  plans,  the  human  must  forecast  or  imagine  the 
consequences  of  implementing  each  plan.  One  might  assume  that  the  human 
performs  some  type  of  mental  simulation  of  the  plan.  For  example,  the 
human  might  use  his  current  perception  of  the  system  dynamics  to 
extrapolate  the  system  s state  as  a function  of  planned  control  strategy, 
house  has  developed  a model  that  describes  this  type  of  behavior. 
Succinctly,  the  model  assumes  that  the  human  has  both  a long-tenn  and 
short-term  model  of  the  system  with  which  he  is  dealing  and,  that  he  uses  a 
compromise  between  the  two  state  preolctlons  obtained  from  these  models  as 
a basis  for  decision  making  [28] . 

however,  when  plans  are  sketchy,  at  least  in  terms  of  intermediate 
preconditions,  the  human  probably  does  not  actually  calculate  consequences 
but  instead  simply  maps  plan  features  to  previously  experienced 
consequences.  Then,  until  evidence  forces  him  to  reject  the  assumption,  he 
assumes  these  previously  experienced  consequences  will  prevail.  This  type 
of  behavior  is  represented  quite  nicely  by  the  scripts  concept  [22]. 
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Imagined  consequences  are  then  compared  to  goals . For  low  level 
plans>  the  comparison  might  be  based  on  a well-defined  criterion  function, 
however,  this  is  probably  not  the  case  for  high  level  plans.  Since  high 
level  goals  and  Imagined  consequences  may  be  verbal  and  rather  vague,  it  is 
likely  that  the  human  only  tries  to  satisfice  rather  than  optimize.  One 
might  represent  this  phenomenon  using  multi-attribute  utility  Aincti<»is 
L29J  that  have  broad- optima . Alternatively,  concepts  from  fuzzy  set  theory 
[30J,  l31]  might  be  used  to  consider  the  membership  of  a set  of 

consequences  in  the  fuzzy  set  of  acceptable  consequences.  The  utility 
function  approach  is  probably  apprc^riate  if  one  assumes  that  the  human  has 
a fairly  precise  knowledge  of  the  possible  consequences,  and  subsequently 
values  some  more  than  others.  On  the  other  hand,  the  fuzzy  set  approach 
would  seem  to  be  applicable  to  situations  where  the  human  s perception  of 
the  consequences  is  actually  fUzzy. 

The  human  chooses  the  most  satisfactory  plan  and  initiates  its 
execution.  If  none  of  the  available  plans  meets  an  acceptable  level  of 
satisfaction,  the  human  either  tries  to  debug  the  set  of  plans  under 
consideration  or  perhaps  tries  to  develop  new  plans.  Debugging  of 
partially  failed  plans  may  initially  involve  local  experimentation  to 
determine  the  cause  of  plan  failure  rather  than  a global  reevaluation  and 
complete  replanning  C32l.  One  approach  to  modeling  debugging  or 
trouble-shooting  of  plans  is  with  fuzzy  set  theory  [333. 

Assuming  that  a plan  has  been  initiated,  the  human  monitors  its 
execution  and  only  becomes  involved  (in  the  sense  of  planning)  if  the 
unanticipated  occurs  or  execution  reaches  the  point  that  some  phase  of  the 
plan  must  be  more  concisely  defined.  Monitoring  for  the  unexpected  might 
be  modeled  using  production  systems  that  trigger  when  the  preconditions  are 
not  satisfied.  Other  approaches,  based  on  filter  theory  [3^3  or  pattern 
recognition  methods  [353,  are  also  available  but  beyond  the  scope  of  the 
discussion  here. 

Once  the  unexpected  has  been  detected,  planning  might  shift  into  the 
above  mentioned  debugging  mode.  ■ On  the  other  hand,  the  need  to  shift  fr<xa 
SKetchy  to  concise  planning  may  involve  abandoning,  lor  the  moment,  the 
broad  hierarchical  mode  and  shifting  to  a detailed  partially  pre-programmed 
mode. 


How  do  all  these  bits  and  pieces  fit  into  an  overall  model  of 
planning?  khlle  it  does  seem  that  the  hierarchical  approach  to  planning 
combined  with  the  production  system  and  script  ideas  provide  a reasonable 
framework,  the  state-of-the-art  certainly  does  not  allow  one  to  construct  a 
context-free  planning  model  in  the  form  of  an  executable  computer  program. 
This  may  be  an  inherent  limitation  if  one  accepts  the  premise  that  much  of 
human  behavior  is  merely  a reflection  of  the  task  environment  [13.  If  this 
premise  is  true,  then  one  should  be  very  careful  that  laboratory 
abstractions  capture  a sufficient  portion  of  the  real  world  environment  and 
thereby  allow  results  to  actually  be  transferable.  Otherwise,  one  is  only 
developing  a theory  of  human  behavior  in  laboratory  games. 
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As  a final  comment  on  planning^  a very  important  issue  concerns  the 
level  at  which  one's  study  of  planning  behavior  should  be  addressed.  While 
an  approach  at  the  neuron  level  [36]  sax  eventually  lead  to  a successful 
model  of  human  planning  behavior,  such  an  approach  is  unlikely  to  lead  to 
success  in  the  near  future.  Alternatively,  one  might  try  to  develop  models 
that  explain  or  predict  whether  or  not  a plan  will  be  successful.  However, 
this  type  of  model'  would  yield  little  information  about  the  planning 
process.  It  seems  that  cne  must  approach  studies  on  the  conscious  planning 
level  using  either  verbal  protocols  [1],  [37],  [38]  or  at  least  methods 
that  require  plans  to  be  explicitly  measurable.  Then,  the  variety  of 
approaches  to  modeling  discussed  in  this  section  can  be  applied  to 
describing  the  planning  process . 

IMPLEMENTING  PLANS 


Implementing  plans  refers  to  human  action,  mainly  controlling  and 
reaching  in  the  Jiulti-level  structure  of  Figure  3>  Two  basic  approaches 
for  mathematically  describing  these  actions  can  be  distinguished.  The 
first  approach  Includes  time-line  analysis,  queueing  theory,  and  simulaticxi 
techniques,  tdiereas  the  second  includes  the  control  theoretic  approach  in  a 
more  general  sense. 

In  time-line  analyses,  the  execution  times  of  all  particular  task 
elements  of  a certain  multi-task  situation  are  assessed  as  well  as  the 
total  task  time  needed  [39],  [^0],  [41],  [42].  Available  time  margins  or 
expected  time  pressure  of  ttie  human  operator  can  be  calculated  in  order  to 
estimate  total  task  system  performance  and  human  operator  workload.  This 
method  has  been  applied  to  evaluating  rather  complex  man-machine  systems  by 
taking  these  apart  in  very  much  detail,  e.g.,  to  the  level  of  reaching 
times  for  single  switches. 

A related  but  more  analytical  approach  is  the  queueing  theoretic  one 
[11],  [12],  [43],  [44],  [45],  [46],  [4?].  It  is  suitable  not  only  for 
analysis  but  also  for  design  purposes.  The  different  tasks  of  a 
multi-task  situation  are  considered  as  customers  in  a queue  waiting  to  be 
serviced.  Arrival  and  service  rates  as  well  as  the  waiting  time  for  the 
tasks  are  characteristic  measures . Service  with  a priority  policy  is 

possible.  Also  several  servers  (e.g.,  the  human  operator  and  a computer) 
may  share  responsibility  for  the  total  task. 

Both  approaches,  time-line  analysis  and  queueing  theory,  look  at  the 
implementation  of  actions  in  terms  of  time  expenditure.  If  the  accuracy  of 
the  actions  is  also  to  be  taken  into  account,  these  methods  have  to  be 
combined  with  others.  Simulation  techniques  seem  to  be  a reasonable 
approach  where  micro-subroutines  simulate  dynamically  such  human  operator 
behaviors  as  short-term  memory  recall  and  movement  of  hands  and  feet  [48]. 
This  leads  back  to  the  time-sharing  computer  analogy.  A goal-oriented 
priority  Interrupt  structure  for  handling  all  tasks  appropriately  in  a 
multi-task  situation  is  most  promising.  However,  this  results  in  a more 
artificial-intelligence  oriented  simulation,  using  heuristics  and  data 
handling  algorithms,  rather  than  an  analytical  description. 
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A different  approach  for  the  description  of  human  actions  in 
man-machine  systems  applies  control  theory.  Models  for  continuous  manual 
control  are  well  established.  Numerous  summaries  in  the  forms  of  reports 
and  books  exist  (e.g.,  [49],  [50],  [51])<  Most  popular  are  the 
quasi-llnear  and  the  optimal  control  models.  The  quasi-linear  models 
describe  the  human  control  behavior  by  some  task-specific  modification  of  a 
generalised  transfer  function  which  is  best  satisfied  in  the  crossover 
frequency  region  for  many  controlled  element  dynamics.  In  addition,  an 
internal  human  noise  source  (the  remnant)  summarizes  the  porti<x]  of  the 
human's  output  which  cannot  be  explained  linearly. 

The  optimal  control  model  [52]  Includes  two  noise  sources  and  also  has 
a time  delay  and  a neuromuscular  lag  term  with  a time  constant  similar  to 
that  of  the  quasi-linear  model.  A Kalman  filter  estimates  the  states  of 
the  controlled  element,  whereas  a predictor  compensates  for  the  time  delay. 
The  optimal  gains  are  calculated  with  respect  to  a criterion  function  which 
is  a weighted  sum  of  mean  squared  values  of  state  and  control  variables. 

The  control  theory  models  have  been  aoplied  in  several  domains 
including  aircraft  piloting,  automobile  driving,  ship  piloting,  and 
anti-aircraft  artillery.  Further,  several  display  design  methodologies 
have  been  developed.  A recent  special  issue  of  Human  Factors  reviews  many 
applications  of  control  theory  models  [53]- 

With  both  the  crossover  model  and  the  optimal  control  model,  a 
stochastic  reference  input,  either  forcing  function  or  disturbance,  has 
been  assumed.  Therefore,  these  models  are  mostly  applicable  to  the  inner 
loops  of  manual  vehicle  guidance  and  control  tasks.  In  the  case  of  the 
optimal  control  model,  key  elements  of  this  have  also  been  applied  to 
monitoring  and  decision-making  tasks. 

Many  realistic  tasks  exist,  however,  in  which  deterministic  inputs  are 
domimnt.  Taking  the  ba?ellne  car  driving  scenario  as  an  example,  a more 
complicated  deterministic  input  exists,  i.e.,  the  course  of  the  street. 
For  this  task,  a two-level  model  has  been  proposed  which  has  a closed-loop 
stabilization  controller  and  an  anticipatory  open-loop  guidance  controller 
working  in  parallel  [54],  [55],  The  perceptual  aspects  of  the  anticipation 
of  changes  in  the  course  of  the  street  have  been  explained.  However,  it 
has  been  assumed  that  the  driver  tries  to  eliminate  all  deviations  from  the 
middle  line  of  the  street. 

To  overcome  this  simplification,  the  street  might  be  viewed  as  a 
target  tube  in  which  the  driver  is  allowed  to  move  his  car.  Interestingly 
enou^,  many  other  human  control  tasks  in  vehicle  guidance  and  industrial 
process  control  also  require  controlling  the  state  of  the  system  within  a 
target  tube  rather  than  along  a single  reference  line.  Such  a criterion 
makes  these  tasks  much  more  relaxed  than  one  often  assumes  in  man-machine 
systems  experiments. 

Reviewing  the  control  theory  literature,  some  applicable  methods  for 
controlling  within  a target  tube  were  found.  They  have  never  been  used 
with  man-machine  systems  problems.  One  approach  assumes  a criterion 
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function  which  puts  less  weight  on  small  errors  by  taking  the  fourth  power 
of  the  error  instead  of  the  second  power  as  in  the  optimal  control  model 
[563.  The  other  approach  is  called  unknown-but-bounded  control  [57],  [58], 
[59].  Figure  4 illustrates  how  the  controller  tries  to  keep  the  state  (X) 
of  the  system  always  in  an  effective  target  tube  to  assure  that  it  will 
never  cross  the  boundaries  of  the  outer  target  tube  under  all  expected 
disturbances. 


Figure  4:  Schematic  Presentation  of  the  State  of  the  System  (X) 
as  Affected  by  the  Action  of  the 
Controller  (C)  to  Counteract  Disturbances  (N)  for 
Reachability  of  a Target  Tube 
(from  (573) 

The  unknown»but«bounded  control  approach  combines  state  variable  with 
set  theoretic  descriptions.  Due  to  the  higher  mathematical  effort,  this 
approach  has  infrequently  been  applied  in  automatic  control  situations. 
However,  it  seems  worthwhile  to  consider  this  approach  in  modeling 
biological  or  sociological  systems.  Human  behavior  in  general  is 
goal-oriented  and  the  goal  is  very  often  defined  as  bringing  or  keeping 
some  state  variables  within  a certain  target  set  or  target  tube. 

In  the  baseline  scenario,  the  target  tube  of  Figure  4 would  be  the 
width  of  the  street  or  one  of  its  lanes.  The  effective  target  tube  is 
planned  by  the  driver  as  an  area  Inside  of  which  no  control  actions  are 
necessary  (see  llnear-plus-dead-band  control  laws  in  Glover  and  Schweppe 
(583).  Planning  the  effective  target  tube  might  also  include  some 
fuzziness.  Whether  the  unknown«but-bounded  control  approach  can  be 
combined  with  fuzzy  set  theory  which  has  recently  been  applied  in 
industrial  process  control  [60]  has  not  as  yet  been  investigated. 

Another  interesting  issue  is  the  notion  of  the  internal  model  which 
has  been  considered  to  some  extent  in  the  discussion  of  the  planning 
process.  In  modeling  how  the  human  chooses  among  alternative  courses  of 
action,  an  important  issue  concerns  whether  the  human  possesses  a correct 


151 


Internal  model  of  his  environment  or,  whether  the  model  is  incorrect  as  in 
learning  situations  or,  very  approximative  as  in  large-scale  systems  (see, 
e.g. , [61]).  The  process  of  building  up  an  internal  model  during  learning 
and  how  to  ure  it  by  (hanging  control  laws  or  choosing  among  different 
kinds  of  control  laws  in  time-varying  systems,  should  be  further 
investigated.  The  literature  on  adaptive  manual  control  shows,  for 

example,  that  the  models  assume  a set  of  predetermined  control  laws  matcned 
with  a set  of  different  system  dynamics  (see  e.g.,  [62]). 

This  leads  to  the  idea  of  a memory  for  motor  patterns.  Instead  of 
having  an  input-output  transfer  behavior,  the  human  operator  initializes 
predetermined  motor  patterns  in  many  situations.  These  patterns  are 
slightly  corrected  during  their  actual  execution  (see, e.g.,  [63]).  Good 
examples  are  walking,  bicycle  riding,  and  piano  playing.  Also,  the 
coordination  and  timing  of  a series  of  discrete  manual  control  actions, 
e.g.,  in  trouble-shooting  tasks  or  in  checking  procedures  of  aircraft 
pilots  or  process  operators,  can  be  explained  by  predetermined  motor 
patterns. 


DISCUSSION  AND  OONCLUSIONS 


In  considering  various  approaches  to  tying  all  of  the  discussions  in 
this  paper  together,  the  authors  found  the  diagram  in  Figure  5 to  be  most 
useful.  This  diagram  is  a variation  of  a diagram  discussed  by  Johannsen 
(6t]  for  vehicle  control  tasks  and  Sheridan  [1976]  for  human  control  of 
vehicles,  diemical  plants,  and  industrial  robots. 


r 


Human 


Figure  5:  Hierarchy  of  Hinmn  Behavior 
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This  diagraa  oan  be  used  to  represent  well-defined  nan-machine  systems 
tasks  such  as  those  discussed  by  Johannsen  [64]  and  Sheridan  t65}  as  well 
as  less  well-structured  tasks.  For  example,  goals  oould  mean  success  in 
life,  plans  could  mean  a career  outline,  subplans  oould  mean  a scheme  to 
suooeed  in  a specific  job,  and  aotions  oould  mean  one's  daily  activities. 
Thus,  the  diagram  has  broad  applicability. 

How  oan  one  analytically  deal  with  suoh  a general  description?  If  one 
looks  at  control  theor^  with  a very  general  perspective  that  inoludes 
control  with  respect  to  oontinuous  events  as  well  as  discrete  events,  then 
one  oan  subsume  most  analytical  methods  (e.g. , linear  systems  theory  and 
queueing  theory)  within  the  category  of  control  theory.  This 

generalization,  and  willingness  to  expand  the  set  of  tools  one  utilizes, 
enables  quantitative  analysis  of  a larger  portion  of  the  hierarchy  of 
behavior . 

However,  there  are  limits  to  context-free  analytical  modeling.  First, 
there  is  the  very  important  idea  that  human  behavior  mainly  reflects  the 
task  environment.  Thus,  searching  for  a specific  analytioal  model  of 
general  human  behavior  may  only  be  fruitful  to  the  extent  that  all  task 
environments  are  common.  Perhaps  then,  one  should  first  search  for 
commonality  among  environments  rather  than  intrinsic  human  characteristics. 
In  other  words,  a good  model  of  the  demands  of  the  environment  may  allow  a 
reasonable  initial  prediction  of  human  performance.  Thus,  it  is  reasonable 
to  Initially  assume  that  the  human  will  adapt  to  the  demands  of  the  task 
and  perform  accordingly. 

A second  limitation  to  analytioal  modeling  is  due  to  the  human's  lack 
of  analytioal  thinking,  especially  at  upper  levels  of  the  hierarchy.  First 
of  all,  the  human  is  more  of  a satisficer  than  an  optimizer-  Thus,  ideas 
such  as  a target  tube  within  control  tasks,  fuzzy  set  theory,  and  some 
concepts  from  utility  theory  deserve  more  study  and  application  within 
man-machine  systems.  Vihat  this  means  is  that  one  should  look  at 
optimization  with  respeot  to  broad  criteria  that  allow  multiple 
aatisfaotory  solutions.  An  alteniatlve  approach  to  this  issue  is  to 
discard  optimization,  but  this  would  leave  the  modeler  atripped  of  one  of 
his  most  important  toola  and  without  a viable  alternative. 

Beyond  the  idea  of  aatisf icing,  another  important  limitation  to 
analytical  modeling  is  that  humans  simply  do  not  worry  about  detalla  until 
it  baoomea  necessary  to  do  ao.  Thus,  planning  oan  be  sketchy,  perhaps  in 
the  form  of  soripts.  Suoh  sketchy  planning  oan  mean  a drastic  reduction  in 
mental  workload  and  alao,  that  the  human  has  the  resources  left  to  deal 
with  more  tasks  as  well  as  the  flexibility  to  react  to  unforeseen  events. 
These  oharacterlstios  are  preclaely  the  reasons  why  humans  are  often 
included  In  systema. 

However,  the  soripts  idea  preaenta  a problem-  While  everyone  might 
agree  that  humans  use  scripts  to  expedite  performanoe  of  many  tasks, 
knowledge  of  their  existence  is  not  aufficlent  to  predict  performance.  One 
must  know  what  the  aoript  apeoirically  is.  Thus,  in  complex  tasks,  one 
must  measure  not  only  performanoe  (e.g.,  RHS  error)  but  also  the  script. 


153 


This  suegests  that  verbal  protooola  (perhaps  analyzed  by  a computer  that 
understands  natural  language)  may  be  increasingly  important  research  tools. 

To  conclude,  this  paper  has  presented  a fairly  general,  but  mainly 
verbal,  model  of  human  behavior  in  complex  tasks.  The  ideas  discussed  have 
been  based  on  analysis  of  a specific  complex  task  (car  driving)  as  well  as 
a thorough  review  of  the  literature.  Three  very  specific  ideas  have 
emerged.  First,  control  should  be  looked  at  in  a broad  sense, 
incorporating  a wide  range  of  analytioal  methodologies.  Second,  the  human 
satisfices  rather  than  optimizes  and  criteria  should  reflect  this.  Third, 
higher>level  activities  such  as  planning  require  approaches  that  allow 
incompleteness,  and  approaches  that  capture  the  process  of  these  activities 
and  not  Just  the  results. 


REFERENCES 


1.  Newell,  A.  and  Simon,  H.A.,  Human  Problem  Solving,  Englewood  Cliffs, 

N.J.:  Prentice»Hall,  1972. 

2.  Tsichritzis,  D.C.  and  Bernstein,  P.A.,  Operating  Systems.  New  Yotw: 
Academic  Press,  1974. 

3.  Nabermann,  A.N. , Introduction  to  Operating  System  Design,  Chicago: 
Science  Research  Associates,  Inc.,  1976. 

4.  Sanders,  A.F.,  "Some  Remarks  on  Mental  toad,"  Moray,  N.  (Ed.).  Mental 

Workload,  New  York:  Plenum  Press,  197®. 

5.  Atkinson,  R.C.  and  Juola,  J.F.,  "Search  and  Decision  Processes  in 

Recognition  Memory,"  in:  D.H.  Krantz  et  al.  (eds.):  Contempoi's^y 
Developments  in  Mathematical  Psychology,  Vol.  1.  San  Francisco: 

W.H. Freeman  and  Company,  1974,  pp.  243-293* 

6.  IEEE,  "Current  Perspectives  in  Pattern  Recognition,"  Systems,  Man,  and 
Cybernetics  Ueview,  Vol.  6,  No.  4,  August  1977. 

7.  Sklansky  J.,  "Image  Seg-mentation  and  Feature  Extraction,"  IEEE 

Transactions  on  Systems,  Han.  and  Cybernetics,  Vol.  SMC-8,  No.  4, 
April  1978,  pp.  237-247. 

6.  Winston  P.H.  (Ed.),  The  Psychology  of  Comouter  Vision,  New  York: 

McOraw-Hill,  1975. 

9.  Winston,  P.H.,  Artificial  Intelligence,  Reading,  Mass.: 
Addlson-Wesley,  1977. 

10.  Senders,  J.W.,  "The  Human  Operator  as  a Monitor  and  Controller  of 

Hultidegree  of  Freedom  Systems,"  IEEE  Transactions  on  Hunan  Factors  in 
Electronics,  Vol.  HFE-5,  No.  1,  Septeoftter  1964,  pp.  2-5. 


154 


11.  Carbonell,  J.R.,  "A  Queueing  Model  of  Many- Instrument  Visuax  Sampling," 
IEEE  Transactions  on  Hunan  Factors  in  Electronics,  Vol.  HFE-M,  No.  4, 
Decenfcer  1966  pp.  157-164. 

12.  Carbonell,  J.R.;  Ward,  J.L.;  and  Senders,  J.W.,  "A  Queueing  Model  of 

Visual  Sampling:  Experimental  Validation,"  IEEE  Transactions  on 

Man-Madiine  Systems,  Vol.  MMS-9,  No.  3i  September  1968,  pp.  82-87. 

13.  Rouse,  W.P.  and  Greenstein,  J.S.,  "A  Model  of  Human  Decisiai  Making  in 

Multi-Task  Situations:  Implications  for  Computer  Aiding,"  Proceedings 

of  the  1976  International  Conference  on  Cybernetics  and  Society, 
Washington,  November  1976,  pp.  425-433. 

14.  Sheridan,  T.B.  and  tulga,  M.K.,  "A  Model  for  Dynamic  Allocation  of 
Human  Attention  Among  Multiple  Tasks,"  to  appear  in  the  Proceedings  of 
thfc  Fourteenth  Annual  Conference  on  Manual  Control,  University  of 
Southern  California,  April  1978. 

15.  Chien,  R.T.  and  Snyder,  W. , "Visual  Understanding  of  Hybrid  Circuits 
via  Procedural  Models,"  Proceedings  of  the  Fourth  International  Joint 
Conference  on  Artificial  Intelligence,  Tbilisi,  USSR,  September  1975 
pp,  742-745. 

16.  Perkins  W.A.,  "Model-Based  Vision  System  for  Scenes  Containing 
Multiple  Parts,"  Proceedings  of  the  Fifth  International  Joint 
Conference  on  Artificial  Intelligence,  MIT,  August  1977*  PP.  678-684. 

17.  Vfechsler,  H.  and  Sk  unsky,  J.,  "Automatic  Detection  of  Rib  Contours  in 
Chest  Radiographs,"  Proceedings  of  tne  Fourtn  International  Joint 
Conference  on  Artificial  Intelligence,  Tbilisi,  USSR,  September  1975, 

pp.  688-694. 

18.  Martino,  J.P.,  Tedinological  Forecasting  for  Decision  Making,  New  York: 
American  Elsevier,  1972,  Chap  10. 

19  Sacerdoti,  E.D  , A Structure  for  Plans  eind  Behavior,  Ph.D. 
Dissertation,  Stanford  University,  1975. 

20.  Weissman,  S.J.,  On  a Canputer  System  for  Planning  and  Execution  in 
Incompletely  Specified  Environments,  Ph.D.  Dissertation,  University  of 
Illinois  at  Urbana-Champaign , 1976. 

21.  Carbonell,  J.R.,  "On  Man-Computer  Interaction:  A Model  and  Some 

Related  Issues,"  IEEE  Transactions  on  Systems  Science  and  Cybernetics 
Vol.  SSC-5,  No.  1,  January  1969,  pp.  16-26. 

22.  Schank,  R.C.  and  Abelson  R.P.,  Scripts,  Plans,  Goals,  and 

Understanding,  Hillsdale,  N.J.:  Lawrence  Erlbaum,  1977. 

23.  Anderson,  J.R.  and  Bower,  G.H.,  Human  Associative  Memory,  New  York: 
Wiley,  1973. 


155 


24.  Kohonen,  T.,  Associative  Memory,  New  Yoric:  Springer-Verlag,  1977. 

25.  Vbrfield,  J.N.,  Societal  Systems:  Planning,  Policy,  and  Complexity, 

New  York:  John  Wiley,  1976. 

26  Goldstein,  I.P.  and  Grimson,  E.,  ''Annotated  Production  Systems:  A 

Model  for  Skill.  Acquisiticm,"  Proceedings  of  the  Fifth  International 
Joint  Conference  on  Artificial  Intelligence,  MIT,  August  1977#  pp. 
311-317. 

27.  Wesson,  R.B.,  "Planning  in  the  World  of  the  Air  Traffic  Controller," 
Proceedings  -of  the  Fifth  International  Joint  Conference  on  Artificial 
Intelligence,  MIT,  August  1977,  pp.  473'?479. 

28.  Rouse,  Vf.B.,  "A  Theory  of  Human  Decision  Making  in  Stochastic 

Estimation  Tasks,"  IEEE  Transactions  on  Systems,  Man,  and  Cybernetics, 

‘ Vol.  SMC-7,  No.  4,  April  1977,  pp.  274-283. 

29.  Keeney,  R.L.  and  Raiffa,  H.,  Decision  with  Multiple  Objectives,  New 

York:  Wiley,  1976. 

30.  Zadeh,  L.A.;  Fu,  K.S.;  Tanaka,  K;  and  Shimura,  M.  (Eds.),  Fuzzy 

Sets  and  Their  Applications  to  Cognitive  and  Decision  Processes,  New 
York:  Academic  Press,  1975. 

31.  Kaufman  A.,  Introduction  to  the  Theory  of  Fuzzy  Subsets,  New  York: 
Academic  Press,  1975. 

32.  Davis,  P.R.,  Using  and  Re-Using  Partial  Plans,  Ph.D.  Dissertaticxi, 

University  of  Illinois  at  Urbana-Champaign , 1977. 

33.  Rouse,  W.B.,  "A  Model  of  Human  Decision  Making  in  a Fault  Diagnosis 
Task,"  IEEE  Transactions  on  Systems.  Man,  and  Cybernetics  Vol.  SMC-8, 
No.  5,  Hay  1978,  pp.  357-361. 

34.  Gai  E.  and  Curry,  R.E.,  "A  Model  of  the  Human  Observer  in  Failure 
Detection  Tasks,'-  IEEE  Transactions  on  Systems,  Man,  and  Cybernetics, 
Vol.  SMC-6,  No.  2,  February  1976,  pp.  95-94. 

35  Greenstein,  J.S.  and  Reuse,  W.B.,"A  Model  of  Human  Event  Detection  in 
Multiple  Process  Monitoring  Situations,"  to  appear  in  the  Proceedings 
of  the  Fourteenth  Annual  Conference  on  Manual  Control,  University  of 
Southern  California,  April  1978. 

36.  Scott,  A.C.,  Neurophysios,  New  York:  Wiley,  1977. 

37.  Rasmussen,  J.  and  Jensen,  A.,  “Mental  Procedures  in  Real-Life  Tasks: 
A Case  Study  of  Electronic  Trouble  Shooting,"  Ergonomics  Vol.  17,  No. 
3,  May  1974,  pp. 29 3-307. 


156 


38.  Rasmussen,  J.,  "Outlines  of  a Hybrid  Model  of  the  Process  Plant 

Operator,"  in  Sheridan,  T.B.  and  Johannsen,  G.  (Eds.),  Monitoring 
Behavior  and  Supervisory  Control.  New  York:  Plenum  Press  1976,  pp. 

371-383. 

39.  Siegel,  A.J.  and  Wolf,  J.J.,  Man-Machine  Simulation  Models,  New  York: 
Wiley,  1969. 

Mo  Lint(»,  P.M. ; Jahns,  D.W. ; and  Chatelier,  P.R.,  "Operator  Workload 
Assessment  Model;  An  Evaluation  of  a VF/VA-V/STOL  System,"  Methods  to 
Assess  Workload,  AGARD-CPP-216,1977. 

41  Pew,  R.W.;  Baron,  S;  Feehrer,  C.E.;  and  Miller,  D.C.,  Critical 
Review  and  Analysis  of  Performance  Models  Applicable  to  Man-Madiine 
Systems  Evaluation,  Bolt  Beranek  and  Newman,  Inc.,  Cambridge,  Mass.: 
Rept.  No.  3446,  1977. 

42.  Moray,  N.  (ed.).  Mental  Workload,  New  Yoric:  Plenum  Press,  1978. 

43.  Senders,  J.W.  and  Posner,  M.J.M. , "A  Queueing  Model  of  Monitoring  and 

Supervisory  Behavior,"  in  T B.  Sheridan  and  G.  Johannsen,  (Eds.), 
Monitoring  Behavior  and  Supervisory  Control,  New  Yoric:  Plenum  Press 

1976. 

44.  Rouse,  W.B.,  "Human-Canputer  Interaction  in  Multi-Task  Situations," 
IEEE  Transactions  on  Systems,  Man  and  Cybernetics,  Vol.  SMC-7,  No. 
5,  May  1977,  PP.  384-392. 

45.  Walden,  R.S.  and  Rouse,  W.B.,  "A  Queueing  Model  of  Pilot  Decision 
Making  in  a Multi-Task  Flight  Management  Situation,"  Proceedings  of  the 
Thirteenth  Annual  Conference  on  Manual  Control,  MIT,  June  1977,  pp. 
222-236 . 

46.  Chu,  Y.Y.  and  Rouse,  W.E.,  "Optimal  Adaptive  Allocation  of  Decision 
Making  Responsibility  Between  Human  and  Computer  in  Multi-Task 
Situations,"  Proceedings  of  the  1977  International  Conference  on 
Cybernetics  and  Society,  Washington,  September  1977,  pp.  I68-I85. 

47.  Chu,  Y.Y.  and  Rouse,  W.B.,  "Pilot  Decision  Making  in  a Computer-Aided 
Flight  Management  Situation,"  to  appear  in  the  Proceedings  of  the 
Fourteenth  Annual  Conference  on  Manual  Control,  University  of  Southern 
California,  April  1978. 

48.  Wherry,  R.J.,  Jr.,  "The  Hiunan  Operator  Simulator  - HOS,"  Sheridan,  T.B. 

and  Johannsen,  G,  (Eds.)  1976,  Monitoring  Behavior  and  Supervisory 
Control,  New  Yorit:  Plenum  Press,  1976,  pp.  283-293. 

49.  McRuer,  D.T.  and  Krendel,  E.S.,  "Mathematical  Models  of  Human  Pilot 

Behavior,"  Advisory  Group  Aerospace  Research  Development,  Neuilly  sur 
Seine,  France:  AGARDograph  No.  188,  1974. 


157 


50.  Sheridan  T.E.  and  Ferrell,  W.R.,  Man-Machine  Systems:  Information, 

Control,  and  Decision  Models  of  Hunan  Performance,  Cambridge,  Mass.: 
MIT  Press,  1974. 

51.  Johannsen,  G.,  Boiler  H.E.,  Donges,  S.,  and  Stein,  W. , Der  Mensch  im 

Regelkreis,  Lineare  Modelle,  Munchen:  Oldenbourg,  1977. 

52.  Kleinman,  D.L.;  Baron,  S.;  and  Levison,  W.H.,  '’An  Optimal  Control 

Model  of  Hunan  Response.  Part  I:  Theory  and  Validation,"  Automatics, 

Vol.  6,  1970,  pp.  357-369. 

53.  Rouse,  W.B.  (Ed.),  Special  Issue  on  Applicaticxis  of  Control  Theory  in 
Hunan  Factors,  Hunan  Factors,  Vol.  19.  Nos.  4 and  5,  August  and 
October  1977. 

54.  Donges,  E. , "Experiraentelle  Untersuchung  des  menschlichen 
Lenkverhaltens  bei  simulierter  Strassenfahrt,"  Automobiltechnische 
Zeitschrift,  Vol.  77,  1975  pp.l4l-l46,  195-190. 

55.  Donges,  E.  "A  Control  Theoretic  Model  of  Driver  Steering  Behavior," 
Proceedings  of  the  13th  Annual  Conference  on  Manual  Control,  MIT, 
Cambridge,  Hass,  1977,  pp.  165-171. 

56.  Galiana,  F.D.  and  Glavitsch,  H. , "State  Adaptation  in  Power  Systems 
Control,"  Proceedings  of  the  IEEE  Power  Engineering  Society,  Winter 
Meeting,  New  York,  1973. 

57.  Eertsekas,  D.P.  and  Rhodes,  I.B  , "On  the  Minimax  Reachability  of 
Target  Sets  and  Target  Tubes,"  Automatica,  Vol.  7,  1971,  pp.  233-247. 

58.  Glover,  J.D.  and  Schweppe,  F.C.,  "Control  of  Linear  Dynamic  Systems 
witii  Set  Constrained  Disturbances,"  IEEE  Transactions  on  Automatic 
Control  Vol.  AC-16,  1971,  pp.  411-423. 

59.  Schweppe,  F.C.,  Uncertain  Dynamic  Systems,  Englewood  Cliffs,  N.J.: 
Prentice-Hall,  1973. 

60.  King,  P.J.  and  Mamdani,  E.H.,  "The  Application  of  Fuzzy  Control 
Systems  to  Industrial  Processes,"  Automatica,  Vol.  13,  1977,  pp. 
235-242. 

61.  Sheridan,  T.B.  and  Johannsen,  G.  (Eds.),  Monitoring  Behavior  and 

Supervisory  Control,  New  Yoric:  Plenum  Press,  1976. 

62.  Young,  L.R.,  "On  Adaptive  Manual  Control,"  Ergonomics,  Vol.  12,  1969, 
pp. 6 35-67 4. 

63.  Adams,  J.A.,  "A  Closed-Loop  Theory  of  Motor  Learning,"  J.  Motor 
Behavior,  Vol.  3,  1971,  pp.  111-150. 


158 


64,  Johannsen.  G,,  "Preview  of  Man-Vehicle  Control  Session,"  in:  Sheridan, 

T.E.  and  Johannsen,  G.  (eds  ),  Monitoring  Eohavior  and  Supervisory 
Control,  Hew  York:  Plenum  Press,  1976,  op.  3-12 

65,  Sheridan,  T.E.,  •■Peview  of  the  International  Synposium  on  Xonitorine 

Behavior  and  Supervisory  Control,"  Proceedings  of  the  Twelfth  /innual 
Conference  on  Manual  Control,  University  of  Illinois  at 

Urbana-Champaign , May  1976,  pp.  3-13. 


ORIGINAL 
OF  POOR  QUALTHl 


159 


f N79- 15^00 


PETRI  NETS  AS  A MODELING  TOOL  FOR  DISCRETE  CONCURRENT  TASKS 

OF  THE  HUMAN  OPERATOR 
By  ti).  Schumacher,  G.  Geiser 

Fraunhofer-Gesellschaft  e.  \J,,  Instltut  fOr  Informatione- 
verarbeltung  in  Technik  und  Biologle  (IITB),  Karlsruhe, 

F,  R,  of  Germany 


SUMMARY 


Petri  nets  have  been  developed  as  a fundamental  model  of 
technical  systems  uith  concurrent  discrete  events.  The  major  use 
of  Petri  nets  has  been  the  modeling  of  harduare  systems  and  soft- 
uare  concepts  of  computers.  After  a very  brief  introduction  to 
their  basic  concepts,  the  use  of  Petri  nets  is  proposed  for  mo- 
deling the  human  operator  dealing  uith  concurrent  discrete  tasks. 
Their  properties  useful  in  modeling  the  human  operator  are  dis- 
cussed and  practical  examples  are  given.  By  means  of  an  experi- 
mental investigation  of  binary  concurrent  tasks  uhich  are  pre- 
sented in  a serial  manner  it  is  shoun  hou  human  behavior  may  be 
represented  by  Petri  nets. 


INTRODUCTION 


In  different  application  areas  the  human  operator's  role  in 
man-machine  systems  is  changing  from  that  of  a continuous  con- 
troller to  that  of  a monitor.  This  change  is  happening  in  con- 
trol rooms  of  industrial  plants  and  in  aircraft  piloting,  uhere 
dispatching  of  concurrent  demands  becomes  an  essential  feature 
of  the  human  operator's  task.  Furthermore  the  multiple  task  situ- 
ation is  also  given  in  automobile  driving.  Especially  in  high 
density  traffic  situations  the  driver  has  to  deal  uith  many  con- 
current demands  originating  from  nther  road  users,  from  traffic 
regulation,  and  from  his  oun  vehicle. 

In  general,  concurrent  tasks  are  imposed  on  the  human  opera- 
tor by  displays  or  by  real  events,  their  service  requires  a res- 
ponse from  the  human  operator  uhich  is  specified  by  the  task. 

There  are  continuous  demands  like  the  control  error  of  a con- 
tinuous control  loop  or  there  are  discrete  events,  uhich  require 
continuous  or  discrete  actions  respectively.  These  demands  com- 
pete for  the  human  operator's  attention,  if  they  arrive  in  such 
an  intensity,  that  the  human  operator's  capacity  is  at  least  tem- 
porarily exceeded.  In  this  case  demands  uhich  cannot  be  dispatched 
immediately  have  to  be  stored  in  his  memory,  otheruise they  are  lost. 
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For  the  design  of  such  man-machine  systems,  i.  e.  of  their 
dynamic  properties,  displays,  and  controls,  the  human  strategies 
in  dispatching  concurrent  demands  have  to  be  described  by  means 
of  experimental  investigations  and  resulting  quantitative  models. 
Notions  of  queueing  theory  are  suitable  for  the  formulation  of 
this  task  of  the  human  operator  (refs.  1,  2,  3),  however  instead 
of  analytical  solutions  human  behavior  is  often  studied  by  simu- 
lation. 

In  this  paper  Petri  nets  are  discussed  as  a modeling  tool 
for  the  human  operator  dealing  with  concurrent  demands.  As  a 
practical  example  the  application  of  Petri  nets  for  modeling 
human  strategies  is  shown.  These  strategies  have  been  evaluated 
by  means  of  an  experimental  investigation  of  binary  concurrent 
tasks  displayed  in  a serial  manner. 


PETRI  NETS 


In  the  following  a brief  Introduction  to  the  Petri  net  is 
given;  a more  detailed  presentation  is  contained  in  ref.  4. 

A Petri  net  is  an  abstract,  formal  model  of  the  information 
flow  in  systems  with  discrete  sequential  or  parallel  events.  Its 
pictorial  representation  is  a directed  graph,  for  which  an 
example  is  shown  in  Fig.  1.  The  graph  consists  of  two  types  of 
nodes:  places  p.  (represented  by  circles)  and  transitions  t. 
(represented  by^bars).  These  nodes  are  connected  by  directed*^ 
arcs  from  places  to  transitions  and  from  transitions  to  places. 

If  an  arc  is  directed  from  node  1 to  node  j,  then  i is  an  input 
to  J,  and  J is  an  output  of  1.  In  Fig.  1,  e.  g. , place  p.  is  an 
input  to  transition  t2,  while  places  P3  and  P4  are  outputs  of 
transition  t^.  The  nodes  and  arcs  describe  the  static  properties 
of  a Petri  net,  its  dynamic  characteristics  are  represented  by 
the  movement  of  tokens  (represented  by  black  dots  within  the 
places).  The  distribution  of  tokens  in  a Petri  net  defines  the 
state  of  the  net  and  is  called  marking  M.  For  each  marking  a 
new  marking  M'  is  defined  by  the  fallowing  rules: 

1.  A transition  is  called  enabled,  if  each  of  its  input  places 
has  at  least  one  token  in  it  (e.  g.  transition  t2  in  Fig.  1 is 
enabled). 

2.  Each  transition  which  is  enabled  may^  fire. 

3.  A transition  fires  by  removing  o.ie  token  from  each  of  its  in- 
put places  and  by  adding  one  token  to  each  of  its  output 
places  (e.  g.  in  Fig.  1,  firing  of  transition  t2  results  in 
two  tokens  in  place  p^,  zero  token  in  p^,  and  one  token  in 
place  P2»). 
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The  formal  description  of  a Petri  net  is  defined  as  a 
four-tupel  of  sets 

C = (P,  T,  I,  0)  . 

uith  P as  a set  of  places,  T as  a set  of  transitions,  I as  the 
input  function,  and  0 as  the  output  function.  The  input  function 
I defines  for  each  transition  the  set  of  input  places  Ktj). 
The  output  function  0(tj)  is  defined  correspondingly.  For  the 
example  shown  in  Fig.  1*^there  are  the  following  seta 


P = P3f  P4^  ’ 

T ^2*  ^3’  ^4^  ’ 


Ktg)  = ip^,  p^^l  , 
Ktj)  = Ipgl  , 
I(t^)  = Ip3}  , 


Q(t^)  = Ip^)  , 
□(tg)  = Ipgl  , 

= ^P3»  P4^  • 


The  vector  P = (P.,  Pi;,...,Pn)  gives,  for  each  of  the  n 
places  in  the  net,  the  number  of  tokens  in  that  place.  A Petri 
net  C = (P,  T,  1,0)  with  the  marking  P becomes  the  marked  Petri 
net  C*  = (P,  T,  I,  0,  P). 

An  important  tool  for  analysis  of  systems  modelled  by  a 
Petri  net  is  the  reachability  tree.  It  consists  of  a tree,  whose 
nodes  represent  markings  of  the  Petri  net,  and  whose  arcs  repre- 
sent the  transitions  which  are  enabled.  The  Petri  net  shown  in 
Fig.  1 has  the  following  degenerated  reachability  tree: 


o, 

0,  Q, 

1) 

1*2 

<2, 

1,  0, 
I 

0) 

l‘3 

(2, 

0,  1, 

1) 
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PROPERTIES  OF  PETRI  NETS  UITH  REGARD  TO  THE  DESCRIPTION  OF 

THE  HUMAN  OPERATOR 


In  the  fallauing  the  properties  of  Petri  nets  are  summarized 
uiith  regard  to  the  description  of  the  human  operator  dealing  uith 
discrete  concurrent  demands  (Table  1). 

- Description  of  sequential  and  parallel  processes 

- Description  of  interactions  betueen  parallel  processes 

- Interpreted  and  uninterpreted  modeling 

- Hierarchical  modeling 

- Description  of  temporal  order 

> Description  of  deterministic  and  stochastic  processes 

- Modeling  of  priority  systems 

- Formal  and  graphic  description 

Table  1:  Properties  of  Petri  Nets  uith  regard  to  the  Modeling  of 
the  Human  Operator 


Petri  nets  are  suitable  for  the  description  of  sequential 
and  parallel  concurrent  demands  of  the  human  operator  as  uell.  A 
net  having  only  one  token  at  the  same  time  is  describing  a se- 
quential process.  The  position  of  the  token  represents  the  state 
of  the  'sequence  control  register'  of  the  process.  The  graphic 
reppHoentation  of  such  a net  containing  only  transitions  uith 
one  input  and  one  output  corresponds  to  the  usual  flou-chart. 

Fig.  2 shoua  as  an  example  the  observation  of  a traffic  light 
represented  by  a flou-chart  and  by  a Petri  net. 

A net  having  more  than  one  token  at  any  time  describes  a 
non-sequential  process.  Several  tokens  may  result  from  a transi- 
tion uith  several  output  places  or  they  are  an  initial  marking. 
Fig.  1 shous  a Petri  net  uith  an  initial  marking  of  four  tokens. 
Therefore  it  describes  a system  of  partially  parallel  activities. 
It  may  ce  interpreted  as  a general  model  of  the  dispatching  of 
noncurrent  demands,  presented  in  a serial  manner  to  the  human  ope- 
rator. Concurrency  is  given  by  the  fact,  that  during  the  service 
□f  one  demand  other  demands  are  ualtlng  or  arriving.  Then  places 
p^  to  P4  of  Fig.  1 have  the  follouing  interpretations: 
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p^:  number  of  demands  waiting  for  service  (represented  by  the 

corresponding  number  of  tokens), 

P2:  one  demand  Is  being  served, 

p^:  one  demand  has  been  served, 

Pj^;  the  human  operator  is  :e;idy  for  the  next  service. 

The  description  of  parallel  activities  by  Petri  nets  can  be 
applied  to  the  modeling  ot  Interactions  between  different  stages 
of  human  information  processing  and  between  the  tasks  of  several 
operators  as  well.  3 shows  as  an  example  the  crossing  of 

two  automobile  drlv&z-t:'  v^ere  two  conflicting  transitions  without 
indication  of  priority  ...\-3t.  Modeling  of  priority  systems  is 
considered  later  on. 

The  interpretation  of  the  Petri  net  shown  in  Fig.  1 may  be 
specified  with  regard  to  practical  applications.  E.  g.  the  de- 
mands may  represent  traffic  signs  which  have  to  be  observed  by 
the  driver  or  they  are  alarms  of  an  Industrial  plant  presented 
on  displays  in  the  control  room.  On  the  other  hand  Petri  nets 
exist  as  uninterpreted  models  of  which  the  abstract  properties 
may  be  investigated. 

Another  valuable  feature  of  Petri  nets  is  their  ability  'o 
model  a system  hierarchically.  This  means  that  parts  of  the  human 
information  processing  may  be  represented  by  a single  place  or 
transition  in  order  to  have  a more  abstract  model.  Conversely 
places  and  transitions  may  be  specified  by  subnets  in  order  to 
get  a more  detailed  description.  The  example  of  Fig.  1 is  an 
extremely  abstract  model  of  the  human  operator,  which  will  be 
specified  by  means  of  experimental  results  in  chapter  4. 

Petri  nets  describe  the  possible  sequences  of  events,  they 
do  not  reflect  the  variable  amounts  of  time  required  by  the 
different  events.  Because  of  this  property  Petri  nets  give  no 
information  about  the  duration  of  information  orocessing  of  the 
human  operator. 

Petri  nets  are  suitable  for  the  modeling  of  deterministic 
and  of  stochastic  sequences  of  events.  Deterministic  sequences 
ever  have  one  transition  being  enabled,  while  stochastic  sequen- 
ces lead  to  situations  in  which  more  than  one  transition  is 
enabled.  The  choice  of  the  next  transition  to  be  fired  occurs 
randomly.  Fig.  k shows  two  types  of  stochastic  firing  of  tran- 
sitions. Concurrent  transitions  may  fire  in  either  order  whereas 
in  conflicting  transitions  the  firing  of  one  will  disable  the 
other. 
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In  order  to  model  priority  systeme  Petri  nets  uere  extended 
by  inhibition  arcs  represented  by  an  arc  uiith  a small  circle  in- 
stead of  an  arrouhead.  An  inhibition  arc  from  place  p^  to  transi- 
tion tj  enables  the  transition  only  to  fire  if  the  place  has 
zero  token  in  it.  Fig.  5 shous  as  an  example  the  crossing  of  tuo 
drivers  (compare  Fig.  3)  uith  priority  of  driver  1,  described  by 
an  inhibition  arc. 

Furthermore  Petri  nets  may  be  described  in  a formal  as  uiell 
as  in  a graphic  manner.  Especially  the  graphic  representation 
seems  to  be  a useful  tool  in  describing  complex  information  pro- 
cessing of  the  human  operator. 


MODELING  OF  HUMAN  STRATEGIES  IN  DISPATCHING  CONCURRENT 

DEMANDS  BY  PETRI  NETS 


Experimental  Set-up 

In  order  to  investigate  the  human  behavior  in  dispatching 
concurrent  demands  a simulator  for  the  generation  of  the  demands 
and  for  their  service  has  been  established.  Fig.  6 shous  the 
block  diagram  of  the  experimental  set-up.  There  are  6 streams  of 
binary  demands  presented  by  the  numbers  1 to  6 on  a common  nume- 
ric display  to  the  operator.  The  arrival  pattern  of  each  stream 
is  given  by  the  Poisson  distribution.  The  service  of  each  de- 
mand consists  in  pressing  a corresponding  push-button  during  a 
fixed  lapse  of  time  uhich  is  indicated  by  a service  time  lamp. 

The  traffic  intensity  P,  i.  e.  the  ratio  of  the  service  time  and 
the  mean  interarrival  time  of  the  demands,  varied  in  the  range 
0.8  ^ p S 1,6.  The  service  of  the  demands  had  to  be  done  in  the 
order  of  arrival.  The  experimental  sessions  consisted  of  five 
trials  of  200  s duration  each.  After  each  trial  the  traffic 
intensity  was  increased  by  an  amount  of  0.2,  beginning  uith  the 
value  of  P » 0.8.  For  p ^ 1 the  human  operator  is  unable  to  deal 
uith  the  demands  as  fast  as  they  arrive.  Consequently  the  demands 
have  to  queue  up  in  the  operator's  short  term  memory.  Because  of 
its  limited  capacity  demands  may  be  lost.  By  recording  the  service 
activities  of  the  subjects  the  strategies  in  dealing  uith  con- 
current demands  could  be  evaluated. 

In  the  follouing  the  results  from  one  experiment  are  pre- 
sented, further  inveetigatione  uith  this  experimental  set-up  are 
described  in  ref.  5. 


Experimental  Results 

In  order'  to  analyse  the  human  strategies  the  contents  of 
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the  memory  were  evaluated;  it  Is  called  uaitlng-room  diagram. 

Fig.  7 ehoua  a typical  uaiting-room  diagram,  where  the  number  of 
demands  in  waiting-room  1,  1.  e.  the  length  of  the  queue,  is 
platted  aa  a function  of  time.  At  the  arrival  of  a demand  the 
length  of  the  queue  increases  by  one,  at  the  beginning  of  a ser- 
vice the  plot  decreases  by  one.  The  upper  plot  shows  the  ideal 
waiting-room  diagram,  which  is  based  on  the  assumption  that 
there  is  an  infinite  waiting-room.  All  arriving  demands  are  wai- 
ting for  service,  no  demand  is  lost.  The  lower  plot  shows  the 
minimal  waiting-room  diagram,  with  the  assumption  that  lost  de- 
mands did  never  enter  the  waiting-room.  Demands  which  are  not 
served  are  marked  by  a "N”.  By  asking  the  subjects  to  communicate 
the  contents  of  their  memory  at  certain  time  instants,  it  could 
be  shown  that  the  real  waiting-room  diagram  corresponds  largely 
to  the  minimal  waiting-room  diagram. 

By  the  analysis  of  the  waiting-room  diagram  and  supported 
by  statements  of  the  subjects  two  strategies  for  the  service  of 
the  concurrent  demands  can  be  specified: 

- Iitaiting-room  with  permanent  access 

The  demands  enter  into  the  waiting-room  and  queue  up  until  a 
maximum  length  of  the  queue  (Imax  **  reached.  Then  if  one 

demand  is  served  another  may  enter. 

- Uaiting-room  with  intermittent  access 

The  demands  enter  the  waiting-room  and  queue  up.  By  certain 
triggering  events  all  arriving  demands  are  rejected  until  the 
length  of  the  queue  is  reduced  to  a low  value.  Triggering  events 
are  the  reaching  of  a maximum  length  of  the  queue  or  the  arri- 
val of  several  demands  with  short  Interarrival  times.  In  this 
case  the  maximum  length  of  the  queue  is  higher  Cl  *^5)  than 
with  the  strategy  of  permanent  access. 

The  described  strategies  are  extreme  forms  of  behavior,  in 
reality  they  occur  in  an  approximate  and  mixed  form.  The  strate- 
gy with  intermittent  access  can  be  observed  more  often  (factor 
1.5)  than  the  strategy  with  permanent  access.  Fig.  7 shows  the 
waiting-room  diagram  in  the  case  of  intermittent  access.  This 
strategy  is  less  efficient,  because  with  permanent  access  there 
is  a higher  utilization  of  the  waiting-room,  i.  e.  the  mean 
length  of  the  queue  is  increased. 


Modeling  of  the  Human  Strategies  by  Petri  Nets 

The  human  operator’s  activities  in  dealing  with  concurrent 
tasks  are  the  input  of  information,  the  storage  of  information  in 
his  memory  (waiting-room),  and  the  service  of  demands  by  reac- 
tions* Fig.  6 shows  the  Petri  net  of  the  strategy  with  permanent 
access  divided  into  these  three  parts.  For  simplicity  the  waiting- 
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room  is  assumed  to  have  a i paclty  of  three  demands* 

Complementary  places  are  labelled  by  p and  p*.  For  example 
the  interpretation  of  place  p^  ia  "informetion  input  is  idle"  and 
of  place  p2*  "information  input  is  busy".  At  the  arrival  of  a de> 
mand  it  depends  on  the  state  of  the  information  input  whether 
the  demand  is  lost  (place  p^'  marked)  or  not  (place  P2  marked).  In 
the  latter  case  transition  t^  ie  fired  and  the  demano  is  stored 
in  that  position  of  the  waiting-room  (p4  ...  pg).  which  is  free 
and  has  the  lowest  number.  By  the  entrance  of  the  demand  into 
the  waiting-room  (firing  of  transition  t^,  tg  or  tg)  the  infor- 
mation input  is  reset  by  firing  transition  t^^.  Demands  arriving 
when  the  input  is  busy  are  lost  by  firing  of  transition  t2.  Also 
if  the  waiting-room  is  completely  occupied,  i.  e.  the  place  pg  is 
marked,  the  arriving  demand  la  rejected  and  lost  by  firing  of 
transition  tg. 

If  the  waiting-room  is  empty,  the  arriving  cifmand  is  stored 
in  the  first  place  of  the  waiting-room  (marking  of  P(,0.  If  the 
service  mechsnlsm  is  idle  (place  p^’  marked),  then  the  service  of 
this  demand  may  be  carried  out  by  firing  of  transition  t'j  and  by 
setting  free  the  waiting-room  place.  If  there  are  further  demands 
in  the  waiting-room  they  advance  one  step  by  means  of  the  tran- 
sitions tg  and  tg. 

Fig.  9 shows  the  Petri  net  of  the  strategy  with  intermittent 
access.  Compared  with  permanent  access  there  are  modifications 
especially  in  the  input  part  of  the  model.  The  states  of  the 
places  p ^2  P1Z'  determine  whether  arriving  demands  are  re- 
jected or  not.  The  rejection  state  (pi2*  marked)  is  triggered 
if  the  waiting-room  is  completely  occupied,  i.  e.  pg*  is  marked. 
Then  all  demands  are  rejected  and  lost  until  the  waiting-room  is 
empty  and  the  transition  t<|2  is  fired.  Then  arriving  demands 
again  have  access  to  the  waiting-room. 

The  strategies  described  have  been  simulated  by  means  of  a 
digital  computer.  Simulation  data  showed  close  agreement  with 
experimental  results.  The  description  of  the  human  strategies  by 
means  of  Petri  nets  turned  out  to  be  a valuable  tool  for  the  ana- 
lysis of  human  information  processing. 

This  report  was  supported  by  the  German  Federal  Ministry  of 
Defense. 
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Fig.  3:  Petri  net  of  the  crossing  of  tuo  drivers 
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Fig.  4;  a)  Concurrent  and  b)  conflicting  transitions 
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Fig.  5:  Petri  net  of  the  crossing  of  tuio  drivers  uiith 

priority  of  driver  1 
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Fig.  6:  Block  diagram  of  the  experimental  set-up 


Fig.  7:  Ulaiting-rootn  diagram 
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Fig.  B:  lilai ting-room  uiith  permanent  access 
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Fig.  9;  Waiting-room  with  intermittent  access 
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SUMMARY 

The  objective  of  this  paper  is  to  demonstrate  the  originality  of  our  approach  with 
regards  to  already  existing  pilot  models  and  to  present  recently  obtained  results. 

We  consider  the  pilot's  behavior  as  a discrete-time  process  where  the  decision  making 
has  a sequential  nature.  This  model  contrasts  very  clearly  with  previous  approaches  namely 
the  quasi-linear  model  which  follows  from  classical  control  theory  and  the  optimal  control 
model  which  considers  the  human  operator  as  a Kalman  estimator-predictor.  We  also  consi- 
der that  the  pilot's  objective  may  not  be  adequately  formulated  as  a quadratic  cost  func- 
tional to  be  minimized,  but  rather  as  a more  fuzzy  measure  of  the  closehess  with  which 
the  aircraft  follows  a reference  trajectory. 

All  model  parameters,  in  the  digital  program  simulating  the  pilot's  behavior,  have  been 
successfully  compared  in  terms  of  standard-deviation  and  performance  with  those  of  pro- 
fessionnal  pilots  in  IFR  configuration.  The  first  practical  application  of  our  pilot  model  has 
been  the  study  of  its  performance  degradation  when  the  aircraft  model  static  margin 
decreases. 


I.  INTRODUCTION 

Research  on  human  operator  models  and  especially  on  models  of  spacecraft,  aircraft 
and  helicopter  operators  has  often  been  influenced  by  the  current  state-of-the-art.  Before 
further  investigation,  the  human  operator  appears  as  highly  adaptative,  versatile,  complex 
and  sufficiently  creative  so  that  we  can  always  recognize  in  the  diversity  of  all  strategies 
he  may  use,  one  we  know  well  and  want  to  find. 

The  first  approach  to  the  problem  was  from  the  control  specialists  of  the  1950's, 
attempting,  at  the  beginning  age  of  servomechanisms,  to  apply  their  basic  tool,  namely  the 
linear  transfer  function  of  a phase  lead  regulator  (ref.  1).  These  studies  relied  heavily  on 
simulation  techniques  using  analog  computers. 

One  of  the  most-commonly  accepted  representations  is  the  quasi-linear  model  of 
McRuer  (ref.  2,  3,  4)  so  named  because  it  represents  the  human  operator  by  a linear  trans- 
fer functicii,  plus  a remnant  to  describe  that  part  of  the  human  response  that  is  not  pre- 
dicted by  the  linear  approximation.  The  transfer  function  is  essentially  the  result  of  an 
approximation  to  the  first  harmonic  and  the  remnant  accounts  for  higher-order  effects  and 
for  other  modeling  errors.  The  most  celebrated  result  from  the  above  study  is  probably 
the  "cross  over  model"  which  is  based  on  the  fact  ^at  the  human  operator  adjusts  the 
parameters  of  his  own  transfer  function  so  that  his  open-loop  response  satisfies  the  closed- 
loop  stability  conditions  with  a reasonable  error. 

At  the  same  time  sampled-data  models  have  been  proposed  (ref.  5).  This  type  of  mo- 
dels is  suitable  for  numerical  computation  on  digital  computers.  However,  the  assumption 
of  fixed  rate  sampling  apr.,ears  as  a weakness  of  this  representation. 

An  alternative  to  the  quasi-linear  modal  has  been  developed  by  Kleinman,  Baron  and 
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Levison  (ref.  6,  7,  8).  This  approach  is  based  on  advanced  optimal  control  and  estimation 
theory  with  the  assumption  that  the  well-trained  human  controller  behaves  in  an  optimal 
manner  subject  to  his  inherent  limitations  and  contraints  and  the  requirement  of  his  task. 
However,  is  the  human  operator  only  a Kalman  estimator  whose  objective  may  be  formu- 
lated as  the  minimization  of  a given  criterion  ? 

These  modeling  studies  have  advanced  a great  step  forward  when  becoming  interdisci- 
plinary through  the  involvement  of  psychologists  in  the  research  teams.  These  scientists  can 
probably  be  credited  for  the  introduction  of  the  concept  of  operating  image  (ref.  9,  10,  11, 
12)  which  is  an  internal  model  of  the  vehicle  allowing  the  human  operator  to  predict  its 
short-term  response.  The  conventional  approach  and  the  purely  psychological  one  are  curren- 
tly merging  (ref.  13).  Without  repudiating  previous  philosophies,  our  current  approach  tries 
to  make  a synthesis  of  them  and  develop  the  model  of  a human  operator  based  on  a new 
and  more  accurate  analysis  of  the  aircraft  pilot's  behavior  (ref.  14,  15,  16,  17). 


II.  ANALYSIS  OF  THE  PILOT'S  BEHAVIOR 

Consider  the  behavior  of  the  human  operator  in  the  case  of  aircraft  control. 

The  aircraft  position  as  sensed  by  the  pilot  from  his  instrument  dials  or  outer  sight  is 

compared  to  the  attitude  required  to  follow  the  nominal  flight  path.  As  an  example,  if  the 

horizontal  oar  of  the  ILS  indicator  lies  above  the  central  mark,  the  pilot  analyzes  this  situ- 
ation and  selects  the  appropriate  correction  maneuver  to  carry  out.  Once  the  maneuver  has 

been  selected,  the  pilot's  brain  (i.e.  the  decision  center)  request  from  the  eyes  through  an 
internal  loop  (fig.  1),  to  collect  information  relating  to  the  longitudinal  attitude.  The  diffe- 
rence between  the  actual  attitude  and  the  desired  one  is  analyzed  and  the  pilot  selects  the 
right  control  to  actuate  and  determines  the  force  to  apply  to  it.  In  this  example,  the  pilot 
pulls  on  the  control  stick  with  a force  he  judges  as  correct  while  requesting  his  arm, 
through  another  loop,  to  sense  the  applied  force.  Stick  motion  is  stopped  when  the  pilot 
feels  that  the  desired  force  has  been  applied. 

CUES  DATA  DATA  OUTPUTS 

COLLECTION  TREATMENT 

By  HUMAN  BY  BRAIN 

SENSORS 
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Hence,  the  decision  center  (the  brain)  puts  successively  into  action  various  loops  while 
asking  for  further  information  from  the  human  sensor.  Three  types  of  loops  may  be  consi- 
dered (fig.  2), 


outer  loops  controlling  the  parameters  related  to  the  shoit-term  safety,  i.e.  flight  path, 
position  and  speed, 

- loops  controlling  the  parameters  related  to  the  immediate  safety,  i.e.  the  attitude  an- 
gles, angle  of  attack,  etc  ....  , 

~ finally,  the  inner  loops  controlling  the  forces  applied  to  the  controls. 

It  should  be  noted  that  there  is  only  a single  loop  in  operation  at  a given  time  and 
this  is  one  of  the  most  fundamental  differences  between  a human  pilot  &nd  an  autopilot. 
The  selection  of  the  currently  operating  loop  is  made  by  the  decision  center  (brain)  which 
designates  the  selected  sensor  to  collect  and  transmit  the  necessary  information  through  an 
internal  loop  (fig.  1). 

An  immediate  consequence  of  this  snalysis  is  that  it  is  impossible  to  determine  direc- 
tly the  pilot's  workload  : at  the  present  time,  it  seems  virtually  impossible  to  follow  in 
detail  the  processing  of  data  taking  place  within  the  brain. 

Another  consequence  is  hat  it  is  useless  to  determine  experimentally  a transfer  func- 
tion representing  'he  pilot's  beha^'lor  since  there  is  not  one,  however  complex,  but  a series 
of  trensier  functions  used  sequentially  in  an  order  determined  by  scanning  of  the  various 
displays.  This  scanning  itself  depends  on  certain  data,  the  environment,  the  pilot’s  training, 
etc...  . that  is  partially  on  random  phenomena.  This  random  nature  must  be  accounted  for 
into  some  part  of  the  pilot's  behavior  mode<. 


III.  RESPECT  OF  THE  CONTROL  LAW 

The  control  law,  which  is  the  keeping  of  permissible  deviations  of  the  controlled  para- 
meters with  respect  to  the  nominal  fli^t  path,  ensures  the  immediate  safety  as  well  as  the 
short-term  safety.  This  law  is  used  by  the  pilot  as  e guideline,  it  depends  on  the  objective 
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set  by  the  pilot  and  on  his  ability  to  adapt  himself  to  the  conditions  of  the  fli^t  phase 
execution. 

First,  the  objective  set  by  the  pilot  may  not  be  formulated  in  the  form  of  a criterion 
to  be  minimized  (as  proposed  by  Kleinman,  Baron  and  Levison  (ref.  6.  7,  8)).  The  pilot  is 
neither  a perfect  being,  nor  a well-trained  monkey  who  as  it  is  well  known,  does  a better 
work  than  a human  operator  when  his  task  is  that  of  a robot.  The  human  brain  can  col- 
1^  a great  number  of  quantitative  and  qualitative  data,  some  of  them  being  only  sensa- 
tions. The  brain  is  able  to  built  a model  of  the  situation,  to  compare  it  with  typical  situa- 
tions held  in  memory,  and  decide  upon  an  action  even  if  the  case  has  not  been  foreseen. 
Then,  the  objective  is  much  fuzzier  : it  consists  on  controlling  the  plane  to  reference  flight 
path  as  close  as  possible  to  the  nominal  flij^t  path.  This  reference  corresponds  to  the 
pilot's  learning  and  his  know  ledge  of  the  plane. 

The  pilot  possesses  rather  remarkable  capabilities  of  adaptation  which  are  evidenced  by 
the  nature  of  his  control  commands.  An  interpretation  of  this  adaptability  is  the  concept 
of  operating  image  or  internal  model.  The  pilot  possesses  a probably  very  simplified  mo^i 
of  the  aircraft  which  permits  him  to  predict  its  short-term  response  given  his  previous 
actions. 

This  concept  of  interrwl  modei  permit  us  to  account  for  the  predictive  nature  of  a 
human  pilot's  control,  as  opposed  to  conventional  autopilots. 


IV.  CHOICE  OF  A MUITILOOP  SEQUENTIAL  MODEL 

Taking  into  account  the  above  considerations,  a mathematical  model  must  satisfy  the 
following  conditions  to  be  as  close  as  possible  to  the  human  pilot's  behavior  (ref.  IS). 

a)  The  elementary  activities  of  data  collection,  development  of  correction  procedures 
and  actuation  of  controls  occur  sequcncially  and  not  simultaneously  as  in  contiruious  type 
models. 

b)  The  various  control  loops  must  be  identified  according  to  the  type  of  aircraft  as 
well  as  the  nature  and  number  of  observed  parameters.  The  type  of  each  loop  must  be 
defined,  namely  as  flight  path  loop  relating  to  short-term  safety,  attitude  loop  relating  to 
immediate  safety,  or  loop  relating  to  the  control  action  (see  fig.  2). 

c)  The  instants  of  time  when  the  various  loops  are  activated  are  not  defined  in  a 
deterministic  manner  but  are  partially  random  (Poisson  process).  Only  a single  loop  can  be 
in  operation  at  a given  time  and  the  pilot  applies  rules  based  on  his  proficiency  and  per- 
sonal experience  from  one  loop  to  another  or  to  monitor  the  instrument  panel.  These  rules 
are  not  strict  and  depend  on  the  pilot's  judgment.  Definition  of  a precise  modei  for  the 
process  of  selecting  among  the  various  loops  is  one  of  the  most  difficult  problems  to  solve 
and  is  fully  ignor^  in  single  loop  models. 

d)  The  rruMiei  must  be  conceived  in  such  a way  that  its  various  characteristic  parame- 
ters be  adjustable  from  one  modei  of  aircraft  to  another  within  a given  type  of  aircraft. 
Obviously,  the  modei  for  a Mach-2  fighter  is  necessarily  different  from  that  of  a conven- 
tional subsonic  aircraft. 

e)  Finally,  the  modei  must  provide  a good  evaluation  of  the  pilot's  workload. 

Research  on  such  a multiioop  modei  called  "discrete-tiaw  model"  because  of  its  se- 
quential nature,  has  been  carried  out  in  France,  at  ONERA  (Office  National  cfEtudes  et  de 
Recherches  Airospatiaies  French  National  Aerospace  Agency)  since  1973.  These  studies 
(ref.  16.  17)  have  led  to  the  development  of  a computer  program  simulating  the  behavior 
of  a pilot  of  a heavy  transport  plane  (Airbus  A300B)  and  capable  to  perform  a particular 
flight  path  (final  descent  of  an  ILS  approach).  The  model  will  soon  be  extended  to  make 
it  adapt  to  various  aircrafts  of  the  same  type  (this  version  is  currently  being  tested  with 

a model  of  the  Dassault  Falcon  20). 
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V.  DESCRIPTION  OF  THE  OISCRETE  TIME  PILOT  HiOOEL 

In  this  model,  it  is  assumed  that,  at  a given  time,  the  pilot  can  either  make  a decision 
or  carry  out  one  of  the  following  three  elementary  actions  : 

actuate  a control, 

~ read  an  information  on  the  instrument  panel, 

~ monitor  a given  parameter  displayed  on  a dial. 

It  is  assumed  that  the  pilot's  strategy,  that  is  the  process  of  selecting  among  the  va^ 
rious  procedures  of  parameter  correction,  has  a sequential  nature  and  is  a function  of  the 
flight  situation  definMl  by  the  aircraft  type  and  condition,  the  flight  phase  and  atmospheric 
conditions. 

Experimental  data  have  led  to  distinguish  between  three  levels  of  activity  in  the  pilot's 
operating  mode  (fig.  3).  This  classification  is  only  an  assumption,  but  seems  to  be  close  to 
reality  and  corresponds  to  the  three  types  of  loops  discuss^  above. 
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Tlie  model  selects  the  correction  procedure  to  be  used  as  a function  of  the  followed 
strategy.  This  procedure  is  further  divided  into  a sequence  of  elementary  actions  (instru* 
ment  reading,  monitoring  of  a parameter,  action  on  a control)  which  are  successively  taken. 

A dual  integration  is  performed  at  each  time  in  the  model,  namely  the  integration  of 
the  equations  of  motion  and  the  integration  of  the  equations  describing  the  operating  image 
of  the  situation  as  memorized  by  the  model. 

In  the  proposed  strategy,  care  has  been  exercised  to  make  a clear  distinction  between 
the  selection  of  dials  monitoring  (a  strategy  with  Markovian  readings  is  used)  and  the  selec- 
tion of  parameter  correction  procedures  (a  strategy  with  short  term  evaluation  is  used).  The 
differenciation  between  these  two  strategies  is  bas^  on  the  concept  of  seriousness  of  the 
instantaneous  situation  as  perceived  by  the  pilot's  model  and  defined  by  : 

G(0)  <*  Max.  estimated  deviation 

on  the  main  

parameters  permissible  deviation 

This  is  the  maximum  ratio,  over  the  flight  path  main  parameters,  between  the  estima- 
ted deviation  (as  memorized  or  predicted  by  the  internal  model)  of  a given  parameter  and 
its  permissible  deviation.  The  permissible  cf^iations  are  determined  experimentally.  If  G(0) 
is  under  a given  minimum  threshold  of  seriousness,  the  situation  is  evaluated  as  safe  and 
the  model  adopts  the  dial  monitoring  strategy  ; if  G(0)  is  above  his  threshold,  the  situa- 
tion is  evaluate  as  serious  and  the  model  applies  the  strategy  of  parameter  correction 
procedures  (fig.  4). 
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Fig.  4 - Owall  straugy. 

As  far  as  the  strategy  of  dials  monitoring  is  concerned,  the  sequence  of  observed  dials 
is  governed  by  a matrix  of  conditional  probabilities  of  reading  >:ach  instrument  after  ano- 
ther  one.  This  matrix  is  called  "switching  matrix".  After  each  instrument  reading,  the  value 
of  a random  variable  determines  which  dial  will  be  read  next,  depending  on  the  switching 
matrix.  The  sequence  of  reading  times  is  regarded  as  a Poisson  process.  Figure  5 gives  an 
example  of  switching  matrix  in  the  case  of  the  ILS  approach  phase  of  an  Airbus  A-300B. 
This  matrix  has  been  determined  experimentally  by  means  of  an  electro  oculometer.  In  re- 
trospect, were  observed  in  this  matrix  the  features  of  elementary  monitoring  rules  during 
IFR  flight.  For  instance,  the  artificial  horizon  was  mostly  observed. 
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The  strategy  of  the  correction  procedures  is  based  on  the  fact  that  the  human  pilot 
makes  decisions  depending  on  the  short-term  predicted  evolution  of  the  situation  while 
taking  into  account  all  previous  actions. 

The  model  har  no  access  to  the  equations  governing  the  aircraft  dynamics  but,  by 
using  its  operating  image,  it  can  predict  approximately  the  short-term  situation.  This  predic- 
tion capability  is  used  by  the  model  to  select  the  best  correction  procedure  to  implement, 
each  time  it  is  necessary.  This  choice  is  made  by  deveiopping  a logical  tree  (fig.  6)  in 
which, 

— the  root  is  the  memorized  situation  (So)  ; 

— branches  are  the  correction  procedures  whose  implementation  is  considered  ; 

— nodes  other  than  the  root  are  situation  predicted  from  the  root  by  means  of  the  ope- 
rating image  while  taking  into  account  the  intented  correction  procedures. 
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Fig.  6 - Strategy  for  correction  procedures. 


The  instantaneous  seriousness  G(K)  is  computed  at  each  node  K.  Considering  that  it 
remains  constant  during  the  time  Ati  elapsed  from  the  previous  node  to  the  node  I,  the 
model  computes  a short-term  mean  seriousness  G(l)  on  each  path  leading  to  a terminal 
node.  To  that  end,  the  instantaneous  seriousness  is  weighted  by  the  time  elapsed  on  each 
branch  and  the  result  is  divided  by  the  total  time  elapsed  on  the  path.  The  short-term 
mean  seriousness  of  a path  (I,  J)  is  then  expressed  by 

G((l,  JJ)  = — -! — X]  G<K)  • Atk 

M ” 'I  K = I J 

The  mean  seriousness  of  the  best  path  G((l,  J])  chosen  at  I is  denoted  G(l).  This 
choice  is  simply  made  by  taking  among  all  possible  paths  from  I the  one  with  the  mini- 
mum mean  seriousness. 

The  path  from  the  root  with  the  minimum  mean  seriousness  is  then  chosen  and  the 
implementation  of  the  correction  procedure  corresponding  to  its  first  branch  can  be  ini- 
tiated. 


VI.  PROGRAM  APPLICATIONS 

Two  appli nations  have  been  made  to  validate  this  program.  Both  apply  to  the  simu- 
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lation  of  the  final  descent  of  the  ILS  approach  phase  for  an  Airbus  A-300B.  First,  a statis- 
tical comparison  has  been  made  between  the  performances  of  the  model  and  those  of  pro- 
fessionnal  pilots.  Secondly,  the  performance  loss  of  the  model  when  the  static  margin  of 
the  simulated  aircraft  is  decreased  has  been  investigated. 

VI, Comparison  between  the  model  and  professionnal  pilots 

It  is  meaningless  to  compare  the  time  responses  obtained  from  the  model  and  from 
human  pilots.  As  good  as  it  may  be,  the  match  between  the  curves  cannot  be  perfect.  A 
statistical  comparison  would  be  more  meaningful.  We  have  therefore  chosen  a comparison 
between  the  standard  deviation  and  the  performance,  which  are  defined  below  for  the  va- 
rious flight  parameters. 

Standard  deviation  ox  = 

Performance  Px  = 

where  t is  the  duration  of  the  final  descent  of  the  ILS  approach  phase. 

The  results  from  the  model  have  been  compared  to  those  of  five  professionnal  pilots 
performing  final  descents  in  IFR  conditions  on  a flight  simulator  representing  the  heavy 
transport  plane  considered  in  this  study.  The  comparison  is  illustrated  in  figure  7 ; it  ran 
be  seen  that  the  model  exhibits  a behavior  close  to  the  pilot's  as  far  as  the  above  defined 
standard  deviations  and  performances  are  concerned. 


Model-pilot  initial  deviations  at  1900  feet 


X human  pilot  Localizer  deviation  : -0.6*’ 

• mnHai  ^i<de  path  devittcion  ; 0,65*’ 

AV  = + 8kts(Va  = 137kt$l 


Fig.  7 - Sumcbrd'd$vi»tions  and  fiarformanm. 
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Vl,2.  Application  of  tto  model  to  flight  control  with  redmxd  static  margin 

One  of  the  first  practical  applications  of  the  model  has  been  the  study  of  its  perfor- 
mance loss  when  the  static  margin  of  the  simulated  aircraft  decreases,  i.e.  when  the  center 
of  gravity  moves  backward,  progressively  destabilizing  the  plane.  It  appears  that  the  perfor- 
mance of  the  model  decreases  when  the  static  margin  is  reduced,  which  seems  realistic.  The 
loss  of  control  occurs  suddenly  (fig.  8)  when  the  workload  resulting  from  a decrease  in 
static  margin  becomes  excessive.  The  most  interesting  result  of  this  study  is  that,  whenever 
control  difficulties  appear  on  the  pitch  axis,  the  overall  aircraft  control  is  impaired  ; for 
most  of  the  cases  losses  of  control  occur  on  the  transversal  axis. 


present9thn  for  finof 
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Fig.  8 - Basic  ILS  approaches  with  reduced  static  margins. 


VII.  CONCLUSION 

The  model  described  in  this  paper  is  expected  to  be  more  conform  to  the  actual 
pilot's  behavior  than  those  of  previous  studies.  It  tries  to  make  a synthesis  between  the 
mathematical  approach  and  the  psychological  approach  through  the  introduction  of  the 
aircraft  internal  model. 

In  the  future,  studies  will  attempt  to  introduce  the  concept  of  pilot  adaptativity  to  a 
new  type  of  aircraft  as  well  as  the  concept  of  learning  which  could  take  into  account  the 
degree  of  professionnal  development  of  individual  pilots. 
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ABSTRACT 


During  1976  and  1977,  a modified  YF-16  aircraft  was  used  to  flight 
demonstrate  decoupled  control  modes  under  the  USAF  Fighter  Control 
Configured  Vehicle  (CCV)  Program.  Higher  levels  of  direct  force  control 
were  achieved  by  the  aircraft  than  had  previously  been  flight  tested.  The 
direct  force  capabilities  were  used  to  Implement  seven  manually  controlled 
unconventional  modes  on  the  aircraft,  allowing  flat  turns,  decoupled  normal 
acceleration  control.  Independent  longitudinal  and  lateral  translations, 
jncoupled  elevation  and  azimuth  aiming,  and  blended  direct  lift.  A 
miniature  two-axis  force  controller  was  Installed  on  top  of  the  YF-16 
sldestick  controller  for  commanding  the  decoupled  modes.  At  the  pilot's 
discretion,  the  directional  modes  could  also  be  commanded  using  rudder 
pedals. 

The  unconventional  control  modes  were  flight  evaluated  during 
simulated  operational  tasks,  such  as  air-to-ground  bombing  and  strafing, 
and  air-to-air  tracking  and  defensive  maneuvering.  The  flight  testing 
identified  many  actual  and  potential  uses  for  these  control  modes,  but 
also  identified  areas  where  refinements  are  needed  to  arrive  at 
operationally  suitable  implementations.  This  paper  describes  the  design, 
development,  and  flight  testing  of  these  new  control  modes.  It  includes 
lessons  learned  in  the  areas  of  unconventional  control  law  Implementation 
and  controller  design.  The  need  for  task-tailored  mode  authorities,  gain- 
scheduling  and  selected  closed-loop  design  is  discussed. 

INTRODUCTION 


The  Air  Force  Flight  Dymmics  Laboratory's  Fighter  CCV  Advanced 
Development  Program  was  conducted  to  develop  and  evaluate  advanced  control 
concepts  for  improving  fighter  aircraft  mission  effectiveness.  Specific 
new  control  degrees  of  freedom  were  provided  in  an  existing  high- 
performance  fighter.  Control  modes  selected  for  Implementation  had  been 
identified  by  previous  research  efforts  as  possessing  the  potential  for 
significantly  improving  fighter  aircraft  performance.  Use  of  these 
unconventional  control  modes  provided  the  pilot  with  unique  aircraft 
maneuvering  capabilities.  This  program  provided  the  first  true  test  of 

f AOS  INTEWTlONA'-l-Y 


109 


the  utility  (if  these  new  capabilities.  Design,  modification  and  flight 
testing  were  conducted  under  contract  to  General  Dynamics/Fort  Worth. 

The  YF-16  shown  in  Figure  1 was  uniquely  suited  as  a testbed  for  the 
program.  It  served  as  a state-of>the-art  baseline  configuration  with  its 
full  authority  quad  redundant  analog  Fly-by-Wire  control  system,  sldestlck 
controller,  and  advanced  aerodynamic  design  employing  vortex  lift  and 
leading  edge  maneuvering  flaps.  The  aircraft  was  designed  to  be 
statically  unstable  longitudinally  in  subsonic  flight  with  artificial 
stability  being  provided  by  the  control  system.  Angle  of  attack  and  ”g** 
limiting  allowed  full  maneuvering  without  reliance  on  stall  warning  or 
cockpit  Instruments  and  provided  maximum  use  of  the  airframe  load  factor 
capability  throughout  the  flight  envelope.  This  advanced  control  system 
design  facilitated  implementation  of  the  new  CCV  control  modes. 


Cost  effectiveness  and  safety  considerations  were  major  driving 
factors  in  the  configuration  selection  and  design.  In  this  light  only 
minor  modifications  were  made  to  the  YF-16  aircraft.  Although  providing 
a means  of  assessing  the  new  control  capability,  this  approach  prevented 
overall  control  and  aerodynamic  design  optimization.  Exterior  changes  to 
the  aircraft  consisted  of  the  addition  of  twin  all-movable  vertical 
canards.  The  new  surfaces,  canted  outward  30  degrees  from  vertical,  were 
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attached  at  the  engine  Inlet.  The  installation  was  accomplished  without 
altering  the  external  or  internal  mold  lines  of  the  inlet.  Although 
separately  actuated,  the  canards  are  deflected  together  by  the  same  pilot- 
generated  command  signal.  Use  of  the  canards  in  conjunction  with  the 
rudder  enabled  direct  sldeforce  to  be  developed  by  the  aircraft.  The 
flaperons  were  modified  to  allow  both  up  and  down  symmetric  deflections. 
Operation  of  the  flaperons  with  the  horizontal  tall  provided  a direct  lift 
capability. 

An  auxiliary  analog  computer  was  added  to  allow  implementation  of  the 
new  control  laws.  A fail-safe  design  was  required.  Additionally,  the  CCV 
modifications  were  not  to  result  in  degradation  of  the  operational 
vellabillty  of  the  basic  YF-16  control  system.  That  system  was  retained 
Intact  to  provide  suitable  control  and  stability  augmentation.  The 
conventional  YF-16  control  system  formed  the  baseline  configuration  for 
the  program.  It  also  served  as  the  reversion  configuration  should 
problems  cause  CCV  system  disengagement.  The  addition  of  CCV  signal 
Interfaces  was  the  only  change  to  that  system.  Control  reconfiguration  was 
achieved  by  injection  of  bias  signals  and  crossfeeds  to  alter  the  normal 
pilot  commands  or  system  feedbacks.  Operation  throughout  the  aircraft's 
envelope  was  needed  for  a valid  evaluation  of  the  unconventional  modes. 

Gain  scheduling  was  extensively  employed  to  provide  proper  response  as 
flight  conditions  varied.  Emphasis  was  placed  on  obtaining  maximum  CCV 
mode  capability  across  the  mach-altltude  range  without  creating  adverse 
transients. 

Crew  station  changes  Involved  the  addition  of  instruments  such  as 
sideslip,  side  acceleration,  canard  and  flaperon  position  indicators  to 
allow  evaluation  of  CCV  responses  by  the  pilot.  A CCV  control  panel  was 
Installed  to  enable  mode  selection,  and  modifications  were  made  to  the 
trim  button  on  the  sidestick  controller  to  provide  a means  of  commanding 
the  open- loop  CCV  modes. 

UNCONVENTIONAL  CONTROL  MODES 


At  the  pilot's  command  were  si.:  open- loop  modes  illustrated  in 
Figures  2 and  3.  Direct  control  of  the  aircraft's  flight  path  in  two 
axes  was  provided  by  the  Aq  and  A^  modes.  The  aircraft  rotated  in  pitch 
and  yaw  with  the  velocity  vector.^  In  -itch,  a was  held  constant  while 
direct  lift  was  generated  on  the  aircraft.  Sideslip  remained  zero  during 
use  of  the  sldeforce  mode  as  side  acceleration  was  generated  allowing 
turning  of  the  aircraft  without  banking.  Attitude  control  at  constant 
flight  path  angle  was  available  with  the  ai  and  0]^  modes  resulting  in 
Independent  fuselage  pointing  in  either  axis.  Vertical  and  lateral 
translations  were  provided  by  the  012  and  02  modes.  In  this  case 
vertical  velocity  and  side  velocity  were  the  controlled  parameters 
at  constant  aircraft  attitude.  Thus  the  aircraft  could  effectively 
elevate  or  side  step. 
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Fig  2 OpenoLoop  Longitudinal  CCV  Fig  3 Open-Loop  Directional  CCV 

Modes  Modes 

One  closed-loop  node.  Maneuver  Enhanc«»iient  (ME),  was  also  available 
to  the  pilot.  Direct  lift  was  blended  with  basic  aircraft  pitch  control 
in  this  node.  It  provided  an  initial  direct  lift  during  a naneuver  which 
was  washed  out  as  the  conmanded  aircraft  nomal  acceleration  was  obtained. 
Use  of  this  capability  resulted  in  maneuver  quickening.  Due  to  the  use 
of  normal  acceleration  feedback,  a level  of  gust  alleviation  was  also 
provided  as  Illustrated  in  Figure  4. 

Implementation  in  accordance  with  the  approach  of  an  "add  on"  design 
is  Illustrated  with  the  simplified  block  diagrams  in  Figures  5,  6 and  7. 
The  conventional  YF-16  control  system  is  shown  in  solid  black  in  the 
figures.  Dashed  lines  Indicate  the  CCV  nodes.  For  the  three  open-loop 
longitudinal  modes, the  pilot  commands  flaperon  deflection  directly  with 
the  elevator  being  driven  through  a scheduled  crossfeed  gain.  Biases  to 
prevent  opposition  of  the  CCV  commands  are  computed  and  Introduced  into 
the  YF-16  control  system.  In  the  case  of  the  An  mode,  FJf.ure  5,  stick 
command  and  pitch  rate  paths  are  modified  by  the  bias  signals.  CCV 
system  gains  were  determined  using  wind  tunnel  data  and  digitally 
predicted  aircraft  responses. 
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Fig  A Maneuver  Enhancement  Mode 
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Fig  S Simplified  Functional  Block  Diagram  of  the  Mode 
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The  directional  modes  are  structured  In  much  the  same  manner.  The 
pilot  coBuanda  a canard  deflection  with  an  appropriate  crossfeed  to  the 
rudder  as  shown  for  the  direct  sideforce  ax»de  in  Figure  6.  In  this  case 
a gain  scheduled  crossfeed  to  the  flaperons  is  needed  to  counter  rolling 
moments  from  the  canard>rudder  deflections.  Biases  are  also  added  to  the 
yaw  rate  and  lateral  acceleration  feedbacks  of  the  basic  control  system. 
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Fig  6 Simplified  Function  Block  Diagram  of  the  Ay  Mode 

The  one  exception  to  this  type  of  ImpleRientatlon  is  Maneuver 
Enhancement.  As  shown  in  Figure  7,  the  error  between  pilot  command  and 
aircraft  normal  acceleration  drives  the  flaperons  and  horizontal  tail. 

A washout  in  the  pitch  rate  feedback  pathf  and  Integral  plus  proportional 
control  in  the  forward  path»  provides  a "g*'  command  response  in  steady 
state.  Thus  as  the  aircraft  attains  the  commanded  “g**  lsvel»  the  direct 
lift  flaperons  return  to  zero  deflection.  The  technique  provides  an 
instantaneous  direct  life  for  maneuver  quickening.  Gust  alleviation  is 
obtained  when  the  normal  accelerometer  feedback  senses  gust  induced 
aircraft  response  and  drives  the  flaperons  to  counter  it. 

Minor  modifications  to  the  YF-16  cockpit  were  made  to  allow  use  of 
the  cev  modes.  Specific  modes  are  selected  by  the  pilot  using  the  CCV 
control  panel  shown  in  Figure  8.  Any  of  the  three  open-loop  longitudinal 
modes  can  be  commanded  by  fore  or  aft  force  on  the  CCV  controller 
installed  on  the  YF>16  sldestick.  Figure  9.  The  trim  switch  was 
replaced  with  the  two^axis  CCV  force  controller,  and  the  normal  **coolie 
hat"  thumb  button  was  retained.  The  three  open'loop  directional  modes 
can  be  selected  for  operation  through  either  rudder  pedal  inputs  or 
left/right  force  on  the  CCV  controller.  Besides  mode  selection  the 
control  panel  also  provides  the  pilot  with  pitch  and  roll  autopilot 
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functions  as  well  as  node  purification  capability.  Purification  was 
designed  to  allow  engineering  evaluation  of  the  nodes  by  enabling 
various  feedbacks  to  force  '*pure"  steady  state  uncoupled  aircraft*  notion. 
In  this  way  the  adequacy  of  interconnect  and  bias  gain  schedules  based 
on  predicted  CCV  responses  could  be  ascertained.  The  control  panel  also 
provides  a neans  of  renoving  side  acceleration.  Ay,  feedback  to  the  rudder 
in  the  basic  control  systen.  Various  self-test  functions  were  also 
Included  for  systen  checkout  and  diagnosis  on  the  ground. 
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Fig  7 Sinplified  Functional  Block  Diagran  of  Maneuver  ^hancenent 


Fig  8 CCV  Control  Panel 
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Fig  9 CCV  Controller  Installation  on  Sldestick 

The  basic  airplane  sldestick  controller  is  essentially  a force  stick 
although  the  sensors  employed  are  Linear  Variable  Differential  Trans- 
formers which  measure  a very  small  displacement  of  the  stick  resulting 
from  forces  applied  by  the  pilot.  Maximum  command  in  pitch  requires  31 
lbs., and  maximum  roll  requires  a little  more  than  IS  lbs.  Both  axes 
have  parabolic  stick  force  versus  command  gradients.  The  CCV  button 
has  a 0.1  lb.  deadzone  with  a linear  force  versus  command  gradient  up 
to  a maximum  of  3.1  lbs. 

FLIGHT  TESTING 


The  flight  test  program  consisting  of  87  flights  and  totalling  over 
125  flight  hours  was  conducted  at  Edwards  AFB  in  California.  Figure  10 
presents  the  range  of  flight  conditions  over  which  testing  was  performed. 
Initially  the  flight  envelope  was  cleared  in  tests  to  identify  flutter, 
aeroservoelastlc  Instabilities,  or  stability  and  control  problems.  The 
effect  of  the  canards  addition  on  Inlet/englne  operation  and  the  aero- 
dynamic destabilizing  effects  were  also  evaluated  during  the  initial  tests. 
Preliminary  checks  were  performed  to  verify  proper  functioning  of  the  CCV 
control  system.  Engineering  evaluations  were  then  conducted  to  ascertain 
the  functional  adequacy  of  the  CCV  control  system  design  and  to  obtain  data 
for  detailed  evaluation  of  the  various  mode  characteristics.  Figure  10 
also  indicates  test  conditions  for  evaluating  predicted  performance 
improvements  with  Relaxed  Static  Stability  (RSS) . Although  not  covered  in 
this  paper,  the  aircraft's  fuel  system  was  modified  to  allow  a wide  range 
of  center-of-gravity  locations  to  be  evaluated  during  the  later  portion  of 
the  test  program.  Finally  quasi-opera tlonal  tasks  were  conducted 
simulating  air-to-air  gunnery,  formation,  refueling,  air-to-ground 
bombing  and  air-to-ground  strafing. 
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Fig  10  Primary  Test  Points 

The  CCV  modes  produced  responses  as  predicted*  and  the  modified  air- 
craft was  found  to  be  free  of  instabilities.  It  also  possessed  .adequate 
handling  qualities  throughout  the  flight  envelope  up  to  its  angle  of 
attack  and  sideslip  limits.  No  adverse  effect.?  of  the  canards  on  inlet 
or  propulsion  system  performance  were  detected.  Although  the  canards 
were  destabilizing  both  longitudinally  and  directionally*  the  YF-16 
control  system  provided  stability  augmentation  that  effectively 
compensated  for  the  change.  The  engineering  evaluations  provided  data  to 
allow  refining  of  the  CCV  control  system  gain  schedules  which  had  been 
selected  originally  on  the  basis  of  wind  tunnel  information.  The  evalu- 
ations also  verified  the  available  CCV  mode  authorities.  Direct  lift 
levels  of  up  to  + 1.5  g*s  and  side  force  levels  of  0.9  g were  obtained. 
These  capabilities  varied  considerably  with  flight  conditions  since  the 
design  was  to  obtain  maximum  capability*  and  not  to  provide  uniform 
authority.  Yaw  pointing  levels  approaching  + 5 degrees  and  pitch  pointing 
of  approximately  + 2 degrees  were  realized.  Translation  authorities  of 
1500  fpm  rate  of  climb  for  the  a 2 mode  and  40  kts  side  velocity  for  the 
^2  mode  were  demonstrated. 

The  Handling  Qualities  During  Tracking  (HQDT)  technique  developed  at 
the  NASA  Dryden  Flight  Research  Center  and  the  Air  Force  Flight  Test 
Center  was  used  for  engineering  analysis  of  the  CCV  modes  during  tracking. 
For  this  technique*  scored  gun  camera  film  is  used  to  obtain  a 
quantitative  measure  of  handling  qualities*  control  system  characteristics, 
and  precision  controllability  during  high-gain  tracking  tasks.  A fixed 
depressed  reticle  is  used  in  a preplanned  tracking  task  employing  in  this 
case  an  F-4  or  T-38  target  aircraft.  The  air-to-air  tracking  maneuver 
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consisted  of  windup  turns  (WUT)  to  4«5  g's  and  3g  constant  turns.  The 
technique  was  also  applied  to  air-to-ground  runs  with  limited  success. 
Unfortunately,  the  technique  does  not  resemble  most  air-to-ground  delivery 
techniques.  RMS,  mean,  and  median  tracking  errors  along  with  time 
histories  of  plpper  position  relative  to  the  target  are  provided  by  the 
technique.  This  data  was  used  in  connection  with  pilot  ratings  and 
comments  to  evaluate  the  CCV  modes'  usefulness.  Ordnance  was  not  actually 
delivered  because  the  YF-16  testbed  did  not  have  a weapon  delivery 
capability. 

Early  in  the  evaluations,  results  from  tracking  with  Maneuver 
Enhancement  Indicated  the  usefulness  of  this  mode.  Figure  11  is  a 
longitudinal  parameters  comparison  of  the  aircraft  with  and  without  ME 
during  a windup  turn  tracking  task.  The  reduction  in  magnitude  of  pitch 
rate  perturbations  and  pilot  inputs  indicates  a useful  mode  for  precise 
tracking.  Tighter  "g"  control  was  available  to  the  pilot,  and  small 
corrections  could  be  made  without  causing  large  rotational  rates.  This 
preliminary  assessment  proved  to  be  correct  when  pilots  from  the  F-16  Joint 
Test  Force  evaluated  the  modes  in  simulated  air-to-air  gunnery. 
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Fig  11  Windup  Turn  Tracking 
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Overall  assesamenC  of  the  CCV  modes  for  various  operational  tasks  are 
shown  in  Figure  12.  This  is  a consensus  of  pilot  opinion  on  the  potential 
improvement  these  modes  could  provide.  A "G"  or  green  rating  indicates  that 
the  mode  is  either  preferred  or  has  the  potential  for  improvement  over 
conventional  controls.  The  or  yellow  rating  is  used  to  denote  that  the 
mode  did  not  show  a potential  Improvement  over  conventional  controls  or 
that  pilot  ratings  and  comments  were  Inconclusive. 
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Fig  12  CCV  Mode  Assessment 

Maneuver  Enhancement  was  considered  an  Improvement  as  it  was 
Implemented  on  the  test  aircraft  in  all  air-to-air  tasks.  It  provided 
tighter  control  in  a tracking  situation  without  the  usual  rotational 
perturbation.  Pilot  control  was  not  complicated  by  an  additional 
controller  since  this  was  a blended  mode  on  the  normal  sldestlck.  Washout 
of  flaperon  deflections  prevented  saturation  problems  of  the  limited 
authority  direct  lift  capability. 

The  direct  force  modes,  An  and  Ay, were  preferred  over  pointing  or 
translation  for  precise  tracking.  The  mechanization  allowed  pilots  to 
"beep"  CCV  commands  using  the  button  controller  in  much  the  same  manner 
as  a trim  switch.  It  provided  an  immediate  precise  change  in  flight 
path.  Such  a "beep"  technique  was  realizable  because  command  and  release 
cause  no  objectionable  plpper  transients.  The  direct  force  inodes  were 
also  considered  to  hold  promise  for  some  unusual  and  effective  defensive 
maneuvering  capabilities,  but  larger  authority  levels  than  obtainable  on 
the  CCV  YF-16  were  desired  by  most  of  the  pilots. 
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The  pointing  modes  were  difficult  for  manual  pilot  control.  Although 
providing  reasonable  authority  and  precise  fuselage  pointing,  the  command 
had  to  be  held  in  continuously.  Upon  release  of  the  CCV  controller,  the 
pipper  moved  sharply  away  from  the  target  as  the  aircraft  returned  to 
align  with  the  velocity  vector.  This  proportional  input  on  the  CCV 
controller , while  trying  to  keep  the  basic  tracking  solution  through 
changing  forces  on  the  sldestick, resulted  in  what  one  pilot  referred  to 
as  a hand  conflict.  A tendency  existed  to  rapidly  reach  and  hold  full 
pointing  capability  as  the  maneuver  changed.  The  pilot  had  to 
immediately  realize  when  maximum  capability  had  been  reached  and  revert 
to  basic  aircraft  control  for  further  error  reductions.  This  would  result 
in  maneuvering  the  aircraft  with  full  pointing  capability  being 
commanded  and  at  times  introduced  unwanted  lags  In  tracking.  Even  with 
these  drawbacks,  the  mode  was  rated  highly  as  far  as  its  potential  for 
improvement.  Most  pilots  commented  that  an  automatic  tie-in  with  the 
fire  control  system  would  make  a very  effective  gunnery  system. 

The  translation  modes  were  implemented  with  slow  onset  rates  and  low 
steady  state  authorities  which  made  them  unsuitable  for  air-to-air  combat 
maneuvering.  Due  to  the  open-loop  design,  the  aircraft  had  a tendency  to 
coast  after  a translation  command  had  been  removed.  This  was  bothersome 
to  the  pilot  as  he  tried  to  close  on  another  aircraft  since  exact  final 
position  was  not  easily  predicted.  The  translation  modes  could  be  used 
for  formation/station  keeping;  however,  the  task  was  adequately  handled 
with  the  basic  aircraft  controls.  Thus,  a clear  need  for  Improved  means 
of  accomplishing  the  task  did  not  exist.  The  one  exception  was 
application  in  refueling  operation.  The  CCV  modes  were  believed  to  offer 
significant  advantages  in  this  case.  Unfortunately,  due  to  the  limited 
redundancy  in  the  mechanization  and  safety  considerations,  such 
applications  could  not  be  evaluated.  Refueling  with  CCV  modes  engaged 
was  prohibited. 

For  the  air-to-ground  work.  Maneuver  Enhancement  again  demonstrated 
an  improvement  as  implemented  on  the  test  aircraft  (Figure  12).  This  was 
primarily  due  to:  1)  the  gust  alleviation  capability  it  provided;  and,  2) 
the  Increased  response  when  pulling  out  of  a dive.  The  manual  control 
task  was  not  significantly  changed  with  the  blended  implementation  on  the 
sldestick.  Normal  piloting  techniques  could  be  used  for  task  accomplish- 
ment. 


Direct  side  force.  Ay,  received  favorable  pilot  rating  for  both 
strafing  and  dive  bombing.  The  primary  advantage  was  elimination  of 
having  to  roll-pull-roll  back  to  make  directional  corrections.  The 
effect  of  each  correction  could  be  immediately  and  easily  determined 
since  the  basic  sight  picture  remained  unchanged.  Rudder  pedals  for  Ay 
commands  were  well  liked, and  the  pilots  easily  adapted  to  their  use.  The 
authority  provided  appeared  excessive  for  terminal  tracking.  The  mode 
found  only  sparing  application  in  the  air-to-ground  tasks  because 
longitudinal  control  posed  no  specific  problem  and  was  easily  accomplished 
with  the  normal  stick  commands.  Use  of  the  force  button  was  not  natural 
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for  the  pilot  in  these  tasks,  and  cross-talk  between  button  and  stick 
existed. 

Pointing  capability  in  both  axes  was  found  useful  for  strafing  runs. 
Two  techniques  were  used  with  pitch  pointing.  In  the  first  method  the 
plpper  was  allowed  to  walk  up  to  the  target  and  was  then  held  on  the  target 
with  the  pointing  capability  to  provide  a longer  firing  opportunity.  The 
second  technique  involved  using  full  nose  down  pointing  throughout  the 
run.  This  allowed  considerably  more  ground  clearance  during  low-level 
passes.  For  bombing,  the  pointing  modes  were  not  appropriate  since  the 
velocity  vector  was  not  being  changed.  There  was  one  exception.  It 
was  possible  to  use  the  mode  to  mimic  the  translation  mode's  crosswind 
cancelling  capability  vlth  higher  responsiveness.  This  was  accomplished 
by  establishing  a crab  in  the  normal  manner  to  counter  the  crosswind 
and  allow  the  flight  path  to  cross  the  target.  Then  yaw  pointing 
was  used  to  align  the  nose  with  the  resultant  velocity  vector  giving 
the  pilot  a good  HUD  sight-target  picture. 

Longitudinal  translation  was  useful  in  the  power  approach  for 
maintaining  a desired  glide  path.  However,  due  to  the  limited 
authority  and  slow  response, it  was  not  satisfactory  for  strafing  or 
bombing.  In  addition,  the  normal  longitudinal  command  provided  adequate 
control  for  these  tasks.  The  lateral  translation  capability  was  useful 
for  crosswind  corrections  during  both  landing  approach  and  dive  bombing. 

It  could  also  be  used  to  attack  moving  targets  from  an  approach 
perpendicular  to  the  target's  motion.  Slowness  of  response  and  the 
requirement  to  hold  a constant  button  force  during  mode  usage  were 
considered  drawbacks  of  these  two  modes. 

SIMULATION  INVESTIGATION 


Results  of  the  flight  testing  showed  the  need  for  additional 
unconventional  control  mode  studies.  Pilot  comments  clearly  Indicated  the 
capability  provided  by  the  unconventional  modes  had  the  potential  for 
improving  the  aircraft's  effectiveness,  but  some  aspects  of  the  particular 
implementation  on  the  test  vehicle  were  unsatisfactory.  The  two-axis 
force  button  selected  after  evaluation  of  several  types  of  controllers  In 
a fixed-base  simulation  at  General  Dynamics  provided  adequate  for 
engineering  evaluations  but  lacking  for  operational  usage.  Various  mode 
authorities,  responses  and  mechanizations  were  found  to  be  inadequate  for 
tracking  and  weapon  delivery  tasks.  The  flight  test  effort  had  been 
extremely  ambitious  in  terms  of  flight  rate.  This  restricted  modifications 
from  being  accomplished  to  the  CCV  hardware  except  to  satisfy  safety-of- 
f light  requirements.  As  a result  of  these  findings,  the  Flight  Control 
Division  of  the  Flight  Dynamics  Laboratory  initiated  an  extensive 
simulation  investigation  to  be  conducted  on  the  Large  Amplitude  Multi- 
mode  Aerospace  Research  Simulator  (LAMARS)  shown  in  Figure  13.  LAMARS 
comprises  part  of  the  Flight  Dynamics  Laboratory's  Engineering  Flight 
Simulation  Facility  at  Wright-Patterson.  The  sphere,  containing  a single 
place  cockpit,  and  the  30  ft.  support  beam  are  computer  controlled  to 
provide  realistic  cockpit  motion  cues.  The  pilot's  visual  display  is 
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projected  on  the  interior  of  the  20  ft.  sphere.  It  can  be  either  a simple 
sky/earth  image  or  projection  of  terrain  features  from  one  of  two  15  ft* 
by  48  ft.  terrain  boards.  An  air-to-air  target  aircraft  projector  is  also 
included  for  combat  simulations.  The  spherical  contour  provides  a maximum 
266  degree  horizontal  and  108  degree  vertical  field  of  view.  Motion 
capability  of  the  simulator  is  listed  in  Figure  14.  A hybrid  computing 
system  forms  the  core  of  the  simulation  facility.  Nonlinear  aerodynamics 
and  the  complete  YF-16  and  auxiliary  CCV  control  system  have  been  modeled 
on  the  computers. 


Fig  13  LAMARS  Facility 

Major  emphasis  of  the  simulation  program  will  be  the  development  of 
Task-Oriented  CCV  control  modes.  The  LAMARS  effort  will  pursue  two 
different  approaches  in  the  investigation  of  unconventional  aircraft 
maneuvering  capabilities.  The  first  will  be  concerned  with  minor 
modifications  to  the  CCV  modes  as  they  were  Implemented  on  the  YF-16. 
This  approach  is  aimed  at  resolving  basic  problems/shortcomings 
highlighted  during  the  flight  test  program.  Candidate  changes  are 
listed  below: 

* CCV  controller  gradient  variations 

* Alternate  gain  scheduling 

* Integral  command  of  pointing  and  translation  modes 

* Elimination  of  operating  restrictions 
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° Mode  authority  matching  and  tailoring 


OISPtACEMCNT 


BEAM-VERTICAL 

1 10  ft 

BEAM-LATERAL 

1 10  rr 

SPHERE-PITCH 

125  etc 

SPHERE-YAW 

* 25  etc 

SPHERE-ROLL 

125  OtG 

NO-LOAD 

VELOCITY 
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13  C 
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1 1 65  C 

60  DtG/SEC 

1 400  ClC/StC 

SO  OEC/SEC 

1 200  OEC/StC' 

60  OEC/SEC 

* 460  OEC/SEC' 

Fig  14  LAMARS  Motion  Capability 

The  gradient  variations  and  gain  scheduling  are  both  intended  to 
reduce  mode  sensitivity  evident  in  the  air-to-ground  tasks.  An  Integral 
mechanization  would  allow  "pulse"  type  inputs  without  requiring  the  pilot 
to  hold  CCV  commands  during  a tracking  task.  Unfortunately,  this 
quickly  results  in  mode  authority  saturation.  A trim  type  follow-up 
technique  is  needed  in  which  adverse  pipper  motion  does  not  result.  In 
order  to  develop  "pure"  CCV  modes  and  Insure  safety  from  failures  with 
the  limited  redundancy  employed  in  flight  test,  rather  severe 
restrictions  were  placed  on  several  modes.  The  emphasis  will  now  be  on 
obtaining  "useful"  modes  by  reducing  these  restrictions  such  as  bank 
angle  and  a limits  and  accepting  Impure  responses.  In  the  interest  of 
providing  the  pilot  with  a useful  tool,  authority  of  the  modes  will  be 
tailored  to  the  operational  task  and  matched  in  both  axes  for  control 
harmony.  In  addition,  the  CCV  modes  will  be  evaluated  with  several  HUD 
gun-sight  systems  to  ascertain  the  benefits  and  problems  associated  with 
such  use. 

The  second  approach  Involves  alternate  methods  of  providing  the  CCV 
capabilities  to  the  pilot  and  new  control  law  structures.  It  includes 
consideration  of  the  following  techniques: 

“ Blended  modes  using  only  the  YF-16  sldestlck 

* Weapon-line  stabilization  and  Improved  gust  alleviation 

• Closed-loop  velocity  command 

Based  on  the  acceptance  by  the  pilot  of  the  maneuver  enhancement 
mechanization  and  the  fact  that  pilot  workload  was  actually  increased 
with  the  addition  of  another  controller  in  the  cockpit,  blending  of  CCV 
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inodes  with  the  basic  aircraft  controls  is  needed.  Such  blending  must  not 
result  in  adverse  transients  on  initial  command  or  when  reaching  maximum 
CCV  authority.  In  addition,  a means  must  be  provided  to  washout  CCV 
inputs  to  prevent  combat  maneuvering  with  residual  canard  or  flaperon 
deflections.  The  mode  to  be  blended  will  be  selected  based  on  its 
usefulness  in  the  particular  mission  phase  being  flown.  The  techniques 
being  considered  included  frequency  selective  separation  of  CCV  versus 
conventional  stick  Inputs  using  filter  techniques  and  separation  based 
on  detected  command  magnitude  and  rate.  In  both  cases  gradual  removal 
of  the  CCV  mode  in  steady  state  is  required.  A recentering  technique 
allowing  placement  of  CCV  command  gradient  within  the  basic  control 
system  stick  force  gradient  is  also  being  examined.  Such  a technique 
would  provide  the  CCV  capability  as  a vernier  control  for  the  pilot 
while  allowing  normal  aircraft  maneuvering  for  large  Inputs.  Such  a 
recenterlng  scheme  must  allow  full  aircraft  capability  to  be  commanded 
and  must  not  produce  an  unacceptable  stick  force  per  "g"  relationship. 

Work  is  being  conducted  to  arrive  at  an  optimum  design  of  maneuver 
enhancement  to  provide  weapon-line  stabilization  for  improved  gunnery. 

In  this  application  the  primary  design  objective  is  faster  acquisition 
and  better  tracking  as  opposed  to  simply  quickened  maneuvering  response. 
Changes  to  Improve  the  gust  alleviation  capability  are  also  being 
studied,  but  the  focus  is  on  reducing  pipper  disturbance  rather  than 
improving  ride  quality. 

Closed-loop  design  providing  a velocity  conmiand  system  for  the 
translation  modes  is  aimed  at  faster  mode  response  and  the  elimination 
of  coasting.  With  such  a design,  the  pilot  would  command  vertical  or 
side  velocity  instead  of  flaperon  or  canard  deflection.  The  control 
system  positions  the  surfaces  as  needed  to  develop  or  cancel  independent 
translations.  This  would  improve  mode  usefulness  in  tasks  requiring 
precise  positioning  and  possibly  allow  application  to  combat  maneuvering. 

The  flight  test  also  accented  the  need  for  more  operationally 
oriented  evaluation  techniques.  The  HQDT  constant  "g”  and  WUT  tracking 
maneuvers  for  20  to  30  seconds  are  not  reasonable  for  representation  of 
the  air-to-air  combat  situation.  Although  providing  useful  information 
on  basic  control  characteristics  in  a tracking  task,  it  is  not  well 
suited  for  task-oriented  design.  In  an  effort  to  solve  this  problem, 
the  LAMARS  simulation  will  be  using  various  weapon  delivery  scoring 
techniques  based  on  aircraft  position,  target  location  and  munition 
ballistics.  However,  HQDT  type  data  will  be  taken  for  correlative 
purposes.  Target  aircraft  combat  algorithms  to  allow  realistic  operational 
task  evaluation  of  the  CCV  modes  have  also  been  developed. 

CONCLUSIONS 


Flight  testing  of  the  Fighter  CCV  has  provided  valuable  insight  into 
the  implications  to  manual  control  of  uncoupled  aircraft  motions.  A 
pronounced  learning  curve  was  encountered  due  to  the  very  unusual 
maneuvers  possible  with  the  CCV  modes  in  the  flight  evaluation.  While 
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providing  additional  capability,  the  open-loop  modes  sometimes  resulted  in 
an  increase  in  pilot  workload  with  the  addition  of  another  controller. 

Use  of  rudder  pedals  for  Ay  command  was  natural  for  the  pilot.  The  one 
blended  closed-loop  mode,  mneuver  Enhancement, was  found  to  be  beneficial 
during  all  evaluation  tasks.  Although  requiring  optimization,  the 
blending  technique  was  readily  accepted  by  the  pilot . The  flight  test 
program  demonstrated  the  feasibility  of  decoupled  aircraft  control  and 
verified  predicted  performance  levels.  It  also  provided  an  indication 
of  the  usefulness  of  these  new  control  modes  in  operational  tasks. 

The  urgent  need  for  task-oriented  control  mode  investigations  was 
clearly  indicated  during  the  test  program.  The  CCV  modes  were  Implemented 
from  an  engineering  standpoint  of  obtaining  "pure"  motion  with  well- 
behaved  responses  and  maximum  capability  throughout  the  flight  envelope. 
Emphasis  must  now  be  placed  on  designing  to  the  specific  task  application. 
Through  the  use  of  AFFDL's  large  moving-base  simulator  and  lessons  learned 
from  flight  testing,  engineering  efforts  are  underway  to  provide  CCV 
capabilities  to  the  pilot  in  a manner  that  will  significantly  improve 
fighter  aircraft  effectiveness.  Prior  to  adaptation  in  future  designs, 
these  capabilities  must  be  provided  in  ways  which  do  not  complicate  the 
manual  control  task.  A multimode  approach  is  indicated  in  which  the 
pilot  is  provided  with  various  predetermined  combinations  of  conventional 
and  CCV  control  tailored  to  the  specific  mission  phase. 
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Abstract 


Given  adequate  open-loop  specifications,  for  example,  aircraft  handling 
qualities  criteria,  design  techniques,  particularly  modern  control  approaches, 
are  available  to  the  system  designer  for  synthesizing  even  the  most  complex 
flight  control  systems.  Unfortunately,  however,  weaknesses  exist  In  the 
handling  qualities  areas,  particularly  for  ''non-conventlonal"  aircraft  such 
as  V/STOL  and  control  configured  vehicles  (CCV's).  In  this  paper,  an  aug- 
mentation synthesis  method  usable  In  the  absence  of  quantitative  handling 
qualities  specifications,  and  yet  explicitly  Including  design  objectives 
based  on  pilot-rating  concepts,  will  be  presented.  The  algorithm  Involves 
the  unique  approach  of  simultaneously  solving  for  the  stability  aucpnentatlon 
system  (SAS)  gains,  pilot  equalization  and  pilot  rating  prediction  via  opti- 
mal control  techniques.  Simultaneous  solution  Is  required  In  this  case  since 
the  pilot  model  (gains,  etc.)  depends  upon  the  augmented  plant  dynamics,  and 
the  augmentation  Is  obviously  not  a priori  known.  Another  special  feature 
Is  the  use  of  the  pilot's  objective  function  (from  which  the  pilot  model 
evolves)  to  design  the  SAS. 


Introduction 


Given  adequate  design  specifications,  or  aircraft  handling  qualities 
criteria,  and  a valid  system  model,  design  techniques,  particularly  modern 
control  approaches,  are  available  to  the  system  designer  for  synthesizing 
even  the  most  complex  flight  control  systems.  Unfortunately,  however,  weak- 
nesses exist  In  the  design  specification  area  for  non-conventlonal  aircraft 
such  as  V/STOL  and  control  configured  vehicles  (CCV's).  The  assertion  here 
Is  that  due  to  the  "non-conventlonal,"  multi -variable  nature  of  the  vehicle 
(and  the  piloting  task  In  the  case  of  V/STOL),  and  due  to  the  anticipated 
complexity  of  the  systems  Involved,  a "non-conventlonal"  approach  to  the 
control  design  problem  Is  worthy  of  Investigation. 

Since  pilot  acceptance  Is  the  ultimate  criteria.  In  the  absence  of  prior 
pilot  opinion  we  must  predict  pilot  rating.  This  Is  In  contrast  to  design 
methods  which  attempt  to  a priori  define  "good"  dynamics,  and  then  use  a 
model -foil owing  design  technlqueUJ,  that  Is,  design  the  augmentation  so  the 
augmented  system  will  behave  like  the  "good"  model.  One  major  drawback  to 
this  approach  Is  that  one  Is  never  sure  that  the  pilot  will  agree  with  the 
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designers  choice  of  ''good’*  dynamics. 

To  (predict  pilot  rating*  some  form  of  pilot  model  Is  required  and  two 
types  of  pilot  models  exist..  Each  have  been  used  extensively;  they  Include 
describing- function  mode1si.^J  and  optimal  control  modelsi^J.  it  1$  felt 
that  for  the  problem  at  hand  the  optimal -control  pilot  model  Is  Ideal.  It 
Is  more  compatible  with  the  multi -variable  aspects  of  the  problem  and  the 
advanced  control  design  techniques  already  existing.  Also,  the  form  of 
the  pilots  equalization  network  Is  automatically  determined,  a very  Impor- 
tant property  In  this  case. 

Both  pilot  modeling  approaches  have  been  used  primarily  to  study 
closed-loop  system  performance.  Recent  application  areas  for  the  opt1malre<f 
control  model  Include  low-visablllty  landing  of  CTOLt^J  and  STOl  aircraft*-  ** 
and  the  stability  of  the  pilot  aircraft  system  In  maneuvering  f11ghtl®J. 
However,  any  stability  augmentation  systems  In  these  studies  were  designed 
Initially,  from  handling  criteria  for  example,  then  the  system  performance 
evaluated  as  a separate  step.  That  Is,  the  SAS  was  designed  first  using 
the  conventional  approaches  (e.g.,  pole  placement),  then  the  pilot  model 
was  added  around  the  augmented  system  to  evaluate  "piloted*’  system  perfor- 
mance. 

Alternate  approaches  Include  the  pilot  as  part  of  the  plant^^^,  then 
the  SAS  design  proceeds  for  the  ''pilot-augmented'*  plant.  Buy  the  form  of 
the  pilot  model  must  be  assumed  before  beginning  this  design  process,  an 
undesirable  situation  for  systems  with  non-conventlonal  plant  dynamics. 

The  pilot  Is  known  to  adapt  his  gain  and  form  of  equalization  to  the  plant 
and  task,  but  selecting  the  pilot  model  a priori  would  tend  to  Imply 
knowledge  of  and  Invariance  of  the  form  of  pilot  model.  Hence,  the  form  of 
the  pilot  model  should  be  determined  as  an  Integrated  part  of  the  system 
design.  As  stated  previously,  this  Is  naturally  accomplished  with  the 
optimal -control  pilot  model. 

An  analytical  pilot  model  has  also  been  used,  although  not  as  frequently, 
to  predict  pilot  opinion.  The  most  notable  of  these  techniques, .apolled  to 
the  VTOl  hover  task,  was  the  "paper  pilot"  developed  by  Anderson In 
this  approach,  parameters  In  the  pilot  describing  function  of  assumed  form 
are  chosen  such  that  a pllot-ratlno  metric  Is  minimized.  This  metric  con- 
sists of  a measure  of  performance  (e.g.,  rms  tracking  error),  and  a measure 
of  pilot  workload  (e.g.,  the  amount  of  lead  the  pilot  must  Introduce).  In 
an  assessment  of  this  technIquei'wJ  it  was  found  that  a pilot  rating  func- 
tional based  on  easily  measured  motion  quantities  was  adequate  for  pilot 
opinion  prediction.  However,  the  proposed  pilot  model  was  found  to  require 
some  additions  for  better  system  performance  predictions.  Notably,  these 
ImprovMitatf  Included  modification  In  form  (describing  function)  and  the 
addition  of  the  pilot's  remnant  (or  the  “random"  portion  of  the  pilot's  con- 
trol Input.)  Hence,  again  we  see  the  problems  created  by  Imposing  an  assumed 
form  of  the  pilot's  describing  function. 

This  problem  would  appear  to  be  alevlated  by  the  use  of  the  optimal  pi- 
lot model.  In  fact,  HessUU  has  found  that  the  optimal  control  model  can 
be  used  equally  well  for  predicting  pilot  opinion,  and  has  used  this  approach 
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in  analytical  display  dasisn  for  helicopters^^^*^^^.  Use  of  the  optimal 
pilot  model  for  pilot  rating  allows  for  a natural  pilot-rating  metric 
via  the  pilot  model  objective  function.  Proper  selection,  based  on  the 
task,  of  the  state  and  control  weights  in  the  objective  function  pro- 
vides for  the  determination  of  the  pilot  gains,  equalization,  and  pilot 
rating  prediction  simultaneously.  As  we  have  mentioned  previously,  this 
is  a very  important  point  in  dealing  with  systems  with  non-conventional 
dynamics  for  which  the  pilot's  describing  function  may  not  be  known.  If 
this  approach  is  now  integrated  with  the  SAS  design  probl«n,  a proposed 
design  procedure  results. 


The  Pilot  Model 


As  presented  in  Reference  3,  the  optimal  pilot  model  evolves  from  the 
assumption  that  the  well-trained,  well -motivated  pilot  selects  his  control 
input(s).  Op  , subject  to  hwian  limitations,  such  that  the  following  ob'’ 
jective  is  minimized, 

, T 

jp  « e {lim  f (y'Qy  ♦ O^RUp  + oJGfip)<ltJ 

The  dynamic  system  being  controlled  by  the  pilot  is  described  by  the  familiar 
linear  relation 

X • Ap*  ♦ BpOp  ♦ w 

y-Cx  (1) 

where  x is  the  system  state  vector,  Up  the  pilot  control  vector,  y the  out- 
put vector,  and  R is  the  vector  of  zero-mean  external  disturbances  with  co- 
variance 


Etw(t)w*(t+o)]  • ««(o) 


Included  as  human  limitations  are  observation  delay,  t,  and  observation  noise, 
9y.  $0  the  pilot  actually  perceives  the  noise-contaminated,  delayed  states, 
of 


Vp  • CpX(t-t)  ♦ Vy(t-t) 

The  covariance  of  the  zero-mean  observation  noise  may  include  the  effects 
of  perception  thresholds  and  attention  allocation,  and  is  denoted 

ECVy(t)v^(t+o)]  ■ Vy«(o) 

* 

Defining  the  augmented  state  vector,  x * colCx,Up],  the  solution  to  the  problem, 
or  the  pilot's  control  is  given  as 
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Op*  - -6‘'[0;OKpX 

where  Kp  Is  the  positive  definite  solution  to  the  Riccati  equation 
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It  will  be  convenient  to  partition  K such  that 

Rd  ' 
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(2) 


and  note  that  now  the  equations  for  the  optimal  control  Up*  is 

• -1^-1  + 
u*  - -G  'k„  X - 6 'k  Q*^ 

P P3  P4  P 


or  a linear  feedback  of  the  best  estimate  of  the  state,  R,  and  some  control 
dynamics.  (These  control  dynamics  have  been  shown  to  be  equivalent  to  the 
pilot's  neuro-muscular  lag.) 

Now,  the  state  estimator  consists  of  a Kalman  filter  and  a least-mean 
square  predictor,  or 

x(t-T)  « ApX(t-x)  + 2Cp'V'^[?p(t) 


- CpX(t-x)]  + BpUj(t-T) 

x(t)  - B(t)  + A"[x(t-t)  - i(t-T)] 


tTo  model  the  pilot's  remnant,  motor  noise  is  usually  added  to  the  control 
equation.  The  final  pilot's  control  is  represented  by 


i 

u 


* 

P 


-1  - -1 
G 'k^  u*  + G ' 
P4  P 


where 


2Cv„(t)v^'(t+o)]  » Vj^6(o) 
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with  6 * A g + B u* 

r r H 

and  the  estimation  error  covariance  matrix  2 is  the  solution  of  the  Riccati 
equation 


A„s  + eA;  + W > 2C„'V;;^C„l  = [0] 

p p p y p ^ 

This  system  of  equations,  when  solved,  determines  the  optimal -control  pilot 
model . 

Finally,  as  noted  previously,  Hess  has  found  that  when  the  weightings 
on  the  state  and  control  (i.e.,  Q anf  R)  in  the  pilot's  objective  function 
are  appropriately  selected,  the  resulting  magnitude  of  the  pilots  objective 
function,  after  solving  for  the  pilot  model,  is  strongly  correlated  with  the 
pilot's  rating  of  the  vehicle  and  task.  If  the  pilot  rating  is  given  in  the 
Cooper-Harper  system,  the  relation  is 

Pilot  Rating  (PR)  * 2.53  in  (10  Jp)  + 0.28 

Now,  through  this  relation  and  the  solution  of  the  pilot  model  above,  we  now 
have  not  only  a pilot-control  model  but  a prediction  of  the  pilot's  rating  of 
the  dynamic  system. 


Augmentation  Synthesis  Method 

In  the  determination  of  the  pilot  model  parameters  above,  we  have  ex- 
pressed the  system  dynamics  in  terms  of  the  matrices  Ap  and  Bp.  However, 
since  the  augmentation  has  not  been  defined,  the  augmented  plant,  Ap  and 
Bp  is  as  yet  unknown. 

Consider  the  un-augmented  plant  dynamics  to  be  described  by 
X » Ax  + Bu  + w 


where,  as  before,  x is  the  system  state  vector  and  w is  the  same  disturbance 
vector.  However,  A and  B are  now  the  un-augmented  system  matrices,  and  Q is 
the  control  input  vector.  Now,  the  total  control  input  to  the  plant  will  in- 
clude pilot  input,  Qp,  plus  augmentation  input,  or 


u - Up 


Further,  from  the  pilot  model,  we  know  that  although  the  feedback  gains 
(e.g.,  6“'Kp  , 6"'Kp^)  f*ave  not  been  determined,  the  pilot's  control  input 

in  expressible  as 


X - 6‘^K„  u„ 
P P3  P4  P 


(3) 
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Now,  the  estimate  of  the  state,  x,  can  be  expressed  in  terms  of  the  true 
state  plus  some  estimation  error,  i,  or 

A 

X * X + e 


By  treating  this  error  as  another  disturbance,  w » we  can  write  the  pilot's 
control  equation  as  ^ 


ip  - -s-’k 


P3 


X - 


(Note,  the  disturbance  term,  Wp,  can  also  include  the  pilot's  remnant  as 
well.)  Combining  this  relation  with  the  plant  dynamic  and  pilot  equations 
we  have 


• 

A : B ~ 

V ^ 

B 

11  *4* 

X * 

1 ' -1 

-G-’k„  ' -G  'k 

L ^3 : P4J 

X ^ 

_0_ 

“SAS 

where  x = col[x,Up]. 

We  now  may  proceed  to  determine  an  objective  function  for  determining 

“SAS* 


From  the  correlation  between  pilot  rating  and  the  pilot's  objective 
function  we  clearly  see  that  the  best  (i.e.,  lowest)  pilot  rating  implies 
the  lowest  pilot  objective  function.  Therefore,  for  optimum  pilot  rating, 
the  control  should  be  chosen  to  minimize  Jq  as  defined  in  the  pilot 

rating  method.  (This  method  defines  the  state  and  control  weights, 

Q and  R,  as  the  inverse  of  the  maximum  allowable  deviations  in  the  variables 
as  perceived  by  the  pilot.)  Finally,  to  preclude  infinite  augmentation 
gains,  we  must  also  penalize  augmentation  control  energy.  Therefore,  the 
augmentation  is  chosen  to  minimize 


and  Q,  R,  and  G are  as  chosen  in  the  pilot's  objective  function,  Jp. 
This  may  be  written  as 
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where 


'^SAS 


1 T 

= E {Hill  f / G'Px 
T-*«  ' 0 


*'SAS''“SAS 


)dt} 


P = 


CAQCp  + K'  G"''Kp  ; K’  G'^Kp  “ 
^ ^ ^2  ^2i  *^3  *^4 

^ 

K'  G 'Kp  I R+K'  G 'Kp 

*'4  *'3  . *'4  t'4 


and  Instead  of  Equation  3 being  substituted  for  Up  in  the  above  J$as»  we  have 
invoked  a sort  of  separation  principle  and  substituted  the  relation 

“p  " ® *^P^“p 

The  justification  for  this  relation  being  used  lies  in  the  fact  that  we  wish 
to  synthesize  the  augmentation  based  on  how  the  pilot  is  tryi ng  to  perform 
the  control  function  rather  than  on  how  the  pilot  is  capable  of  doing  so. 

With  this  objective  function  and  the  system  dynamics  given  in  Equation  4, 
the  problem  is  now  stated  in  conventional  form,  except  Kp  and  Kp  are  as  yet 
undetermined  of  course.  If  we  assume,  for  example,  ful  state  ^ feedback, 
the  solution  of  this  problem  is  known  to  be 

=Ias  = -f'c®'  : 


or 


where 


“SAS  " u. 


^SA$2  P 


"SAS 


: 

CO 



•'sASj  1 

''SAS^ 

is  the  solution  to  the  Riccati  equation 


A 1 

B n 

1 

r A i B I 

1 

i 

SaS  " ^SAS 

1 

I 

L-"\  I 

-6-1 Kp4 

T * -1 

-G-'Kd  1 -6  'Kd 

^3  ' ‘^4 

- P + K, 


SAS 


'B 

m m 
0 


0]K 


SAS  * ‘^SAS 


(5) 
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We  see  In  this  expression  that  the  solution  for  Ksas  obviously  depends 
on  Kp  (or  Kp  and  Kp  ).  Returning  to  the  Rlccatl  equation  for  the  pilot 
gain  (Equation  2)*  we  also  see  that  that  equation  depends  In  turn  on  the 
SAS  gains  (or  K$As)  since  the  pilot  Rlccatl  equation  involves  the  augmented 
plant  matrices  Ap  and  Bp.  As  a result  of  the  SAS  design  procedure  just  pre- 
sented* we  now  know*  however*  the  SAS  structure.  Returning  to  the  pilot 
model*  we  may  now  Include  this  SAS  structure  specifically*  so  that  Ap  and  Bp 
(as  In  Equation  1)  may  In  fact  be  expressed  as 

= A - BF-'b'Ks,s^ 
and  Bp  ■ B(I  - F-’b'Kjps^) 

Substituting  these  expressions  In  the  pilot  Rlccatl  equation  yields  two 
coupled  Rlccatl  equations*  one  for  the  pilot  gains*  Equation  2*  and  one  for 
the  SAS  gains*  Equation  S.  These  may  be  solved  simultaneously  for  K$as 
Kp  by  Integrating  both  equations  backward.  Note  that  this  solution  does  not 
Involve  a two-point-boundary- value  problem.  The  system  Is  represented  In 
Figure  1. 


A Simple  Numerical  Example. 

Consider  a simple  tracking  task  with  the  controlled  element  (plant)  dy 
namics  considered  In  Ref.  11, 

0(s)/6(s)  » K/s^*  K«11.7 

The  comnand  signal*  0^,  Is  white  noise,  w*  passed  through  the  filter 
6c(s)/w(s)  = 3.67/(s^  + 3s  + 2.25) 


2 

and  E(w)  « 0,  a = 1.0 

If  we  define  the  state  vector  as  x » co1(0(.*0^.e*e)*  we  have  the  plant 
X « Ax  + B6  + 3.67w 


where 

■ 0 1 0 O' 

-2.25  -3.  0 0 

A » 

0 0 0 1 

0 0 0 0 


B'  » [0*0*0*11.7] 
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AUGMENTED  PLANT 


Noise,  v„ 

Motor  _ y 

Noise,  v„ 
in 


PILOT  MODEL 


Figure  1 Piloted  Vehicle  Schematic 


For  this  system,  error  and  error  rate  are  perceived  by  the  pilot  or 


- 0 

1. 

0 

-1. 

0“ 

c 

® 

m 

0 

1. 

0. 

-1. 

The  performance  index,  chosen  consistent  with  Hess's  rating  hypothesis  is 

Jp  = E {lim  i / C(e  - 0)2  + .0162  ^ 

T-^  0 P r 

and  g is  chosen  to  yield  a neuromuscular  lag,  1/tj^  = “ ^0.,  or  xm  = 

0.1  seconds.  Unagumented,  the  pilot  Riccati  equations  are^solved  with  the 
following  noise  statistics  (human  limitations) 

1)  Equal  attention  allocation  between  error  and  error  rate. 

2)  Observation  thresholds  on  error  and  error  rate  = 0.5(units  of  display 

displacement.)  ^ 

3)  Sensor  noise,  (Vy)44/E(yf)  * -20dB  1=1,2  ^ 

4)  Motor  noise,  (Vu;/E(ug)  = -20db,  where  u^.=  -G  Kp  x 

5)  Observation  delay,  x = 0.1  seconds  ^ 

The  "piloted"  system  performance  is  given  in  the  following  table. 


Table  1,  Un-augmented  System  Performance 


(0^  -e)  rms 

r.’ir 


rms 


P 

TTOO 


1.39 


P.R. 

o*- 


* This  pilot  rating  has  been  verified  by  experiment 

Assuming  full -state  feedback,  the  augmentation  control  law  is 

^SAS  “ ■'^l®c  ’ hK  ’ *^3®  ‘ *^4®  ■ '^6^P 
The  SAS  objective  function  is 


so  the  piloted  plant,  including  augmentation  will  be 
X » ApX  + Bp6p  + 3.67w 

where 
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1.  0 0 

-3.  0 0 

0 0 1. 

-11.7K2  -11.7K3  -11. 7K^ 

= [0,0, 0,11. 7(l.Kg)] 

Solving  the  pilot  and  SAS  Rlccati  equations  simultaneously,  and  then  de 
termlning  piloted  system  performance  as  before  yields  the  results  given 
In  the  following  table. 


0 

-2.25 

0 

-11. 7K^ 


Table  2 Augmented  System  Performance 


f 

(e  - 6)  rms 

mam 

P.R.** 

BTjlH 

1.10 

0.89 

1.21 

6.6 

0.79 

0.61 

0.62 

4.9 

1.0 

0.38 

0.35 

0.15 

1.3 

* Note  this  Is  the  numerical  value  of  the  pilot’s  objective  function,  J , 
not  JsAS • ^ 

**  Predicted  pilot  rating  based  on  Jp. 

The  augmentation  gains,  Ki  - K4  and  Kg,  for  the  three  cases  above  are  given 
In  Table  3,  along  with  the  augmented  plant  eigenvalues. 


Table  3 Augmentation  Gains 


f 

Ik 

h 

Plant  Eigenvalues* 

-.009 

mm 

-.017+. 331 j 

10. 

-.016 

.036 

-.142+.982j 

1. 

-.513 

-.090 

.542 

.155 

-.758+2. 40 j 

* Not  Including  noise  filter  eigenvalues  of  course. 

Summary 

In  summary,  we  have  cited  the  flight-dynamic  and  control  problems  of 
non-conventlonal  flight  vehicles  (V/STOL  and  CCV)  due  to  the  complexity  of 
augmentation  required  and  the  lack  of  handling  qualities  objectives.  We 
have  presented  a methodology  Intended  to  be  suitable  for  this  type  of  pro- 
blem. The  method  uses  an  optimal  control  pilot  model,  not  only  to  predict 
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piloted  performance  but  pilot  rating  as  well.  With  the  optimal -control  model 
structure,  we  were  able  to  formulate  the  augmentation  synthesis  problem  as 
an  optimal  control  problem  with  the  parameters  in  plant  matrices  depending 
on  the  pilot  model,  and  vice  versa.  This  necessitates  simultaneous  solution 
of  the  two  (pilot  and  augmentation)  problems.  Me  have  included  the  form  of 
the  solution  under  the  assumption  of  full-state  variable  feedback  and  no 
measurement  noise,  and  a simple  numerical  example. 

The  first  extension  to  be  addressed  will  be  the  solution  for  the  case  of 
limited  state  feedback.  This  case  Is  actually  closer  to  pure  plant  augmen- 
tation than  the  case  addressed  here.  In  our  solution,  and  in  the  example,  we 
have  closed  the  tracking  loop,  and  pure  plant  augmentation  would  only  feed 
back  plant  states.  However,  the  primary  purpose  of  our  discussion  here  was 
to  provide  the  problem  structure  which  would  be  unchanged  regardless  of  aug- 
mentation approach. 

Further  extensions  will  also  Include  the  cases  with  state  estimation, 
with  and  without  measurement  noise.  Also,  the  necessity  of  pre- tuning  the 
pilot  model  will  be  investigated. 
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ABSTRACT 

A new  approach  to  flying  qualities  specification  and  evaluation  is  presented 
which  coordinates  current  research  in  the  areas  of  pilot  ratings,  pilot-aircraft 
modeling  techniques,  and  simulation  and  flight  test  procedures.  A time-domain  pilot 
model  is  described  which  can  model  discontinuous  and  nonlinear  pilot  behavior  in 
conjunction  with  completely  general  time-varying  nonlinear  aircraft  models  to  simu- 
late discrete  manuevers.  This  pilot-aircraft  model  is  applied  to  an  existing  set  of 
in-flight  simulation  data,  and  calculates  tracking  error  and  tlme-on-target  statistics 
for  step  target  tracking  that  directly  relate  to  the  r^rted  pilot  comments  and  ratings. 
Predicted  step  target  tracking  data  for  eighteen  F-5E  flight  conditions  are  presented, 
and  the  use  of  the  method  for  control  system  design  is  demonstrated  using  the  YF-17. 


INTRODUCTION 

Pilot  ratings  and  pilot  comments  often  refer  to  two  basic  kinds  of  evaluation: 

1)  How  well  can  the  aircraft  be  made  to  perform? 

2)  How  hard  is  the  task  to  carry  out? 


Since  these  two  questions  are  asked  simultaneously  by  the  Cooper-Harper 
decision  tree  employed  by  the  pilot  in  assigning  a rating,  performance  and  pilot  work- 
load are  combined  into  a single  scalar  quantity,  the  rating.  Pilot  rating  prediction 
formulas  have  been  developed  that  weight  normalised  statistical  performance,  usually 
an  rms  tracking  error,  along  with  an  assumed  correlate  of  pilot  workload,  such  as  the 
pilot  lead  compensation  constant.  Although  these  methods  have  correlated  well  with 
steady  state  tracking  data,  the  predictive  and  practical  aspects  of  this  approach  have 
yet  to  be  demonstrated,  especially  in  view  of  the  simplifications  required  in  task 
descriptions  and  system  models.  One  basic  proidem  with  these  approaches  is  that 
pilot  model  parameters  of  lead,  reserve  attention  as  defined  by  additional  task 


221 


requirements  on  the  pitot,  or  other  identifisbie  pitot  ohsrsoteristios  are  diffioutt  to 
retate  quantitatively  to  pitot  comments.  Furthermore,  the  limitation  of  pitot  model 
^lysis  to  steady  state  statistics  of  a linearized  pilot-aircraft  model  precludes  analysis 
of  discrete  ft^ht  test  maneuvers  such  as  wind-up  turns  and  step  target  tracking. 

Furthermore,  as  the  control  characteristtos  of  advanced  tactical  aircraft  depend 
increasingly  less  on  the  Ramies  of  the  bare  uiiaugmented  airframe,  the  existing  rela- 
tions of  luutdllng  qualities  evaluation  parameters  to  airframe  dynamics  become  less 
reliable.  Since  most  flying  qualities  evaluation  and  specification  methods  depend  upon 
this  correlation  between  airframe  parameters  and  pilot  ratings,  there  are  now  serious 
deficiencies  in  existing  design  criteria.  MiL-F-8785B,  MilHa*^  Specification,  Flying 
Qualities  of  Piloted  Airplanes,  Reference  1,  presents  boundaries  of  acceptance  in  terms 
of  such  quantities  as  short  period  frequency  and  damping.  These  oriteris  have  been 
obtained  through  operational  experienoe  with  large  numbere  of  past  and  current  aircraft, 
and  preaent  values  of  airframe  parameters  that  correlats  with  pilot  ratings. 

References  2 and  3 present  a timple  and  direct  method  for  evaluating  the  per- 
formance of  a tactical  aircraft  performing  a discrete  step  target  tracking  maneuver. 
This  apprcech  calculates  tracking  error  and  tlme-on-target  statistlos  for  step  target 
tracking  In  a way  that  Is  directly  related  to  befth  pilot  ratings  and  commsnts.  As  an 
illustration  of  this  technique,  the  definitive  in-flight  simulation  atu^  of  longitudinal  fly- 
ing qualities,  iierformed  by  Neal  and  Smith,  Reference  4,  was  analyzed  in  terms  of  step 
target  trading. 

The  objective  of  this  paper  is  to  summarize  References  2 and  3 and  to  present 
further  details  and  applioattcns  of  this  ffying  qualities  prediction  and  evaluation  method 
by  demonstrating  YF-17  control  system  design  tmprovemcmt, 

DISCRETE  AND  STEADY-STATE  TRACKING 

Much  analysis  of  closed  loop  piloted  tracking  has  been  published  for  nmdom 
steady-state  tracking  tasks.  These  studies.  References  S and  6.  for  mcample,  have 
demonstrated  that  pilot  models  are  useful  in  the  prediction  of  tracking  performanmt  of 
continuous  random  tracking  tasks,  and  success  lias  been  achieved  in  eorretating  model 
parametere  with  pitot  opinion  ratinga  obtained  from  flight  simulationa.  Reference  7. 

However,  In  actual  flight  aituations,  the  pilot  it  alto  faced  with  the  task  of  per- 
forming quick  corrections  to  flight  path  or  attitiule  errors.  The  abiliiy  of  an  aircraft 


to  rospond  well  to  such  dlsorato  corrootloni  in  a short  tracking  time  is  therefore  of 
great  importance  to  flying  qualities  analysis.  This  is  particularly  true  in  target  track < 
ing  where  the  target  must  first  be  acquired  and  then  precisely  tracked. 

It  is  clear  that  the  objectives  of  quick  initial  response  and  precise  tracking  once 
the  target  is  acquired  are  to  some  degree  opposed.  If  the  pitot  pulls  the  airplane  toward 
the  target  too  rapidly  , unwanted  overshoot  and  oscillation  about  the  target  may  result. 

On  the  other  hand,  pulling  too  slowly  to  the  target  may  lead  to  steady  tracking  but  with 
a penalty  of  unacceptably  slow  target  acquisition.  The  ability  to  investigate  this  com- 
promise and  predict  how  well  the  overall  task  can  be  achieved  for  a given  aircraft  is 
the  primary  advantage  of  using  time-domain  pilot  models  to  investigate  step  target 
tracking. 

Consider  a target  that  suddently  appears  above  steady'’State  trim  pitch  for  the 
tracking  aircraft.  The  pilot  sees  the  target  and  initiates  a pull-up.  At  some  point,  say 
iO  seconds  into  the  maneuver,  he  will  possibly  change  the  nature  of  his  control  to  initiate 
precision  tracking  and  reduce  steady'State  errors.  By  repeatedhr  flying  this  maneuver, 
he  will  learn  just  how  much  he  can  force  a quick  initial  response  without  producing  over- 
shoot and  oscillation.  The  performance  of  this  step  target  tracking  task  can  then  be 
measured  by  rms  tracking  error  and  time-on-tsrget  for  a given  pipper  size  and  total 
tracking  time. 

The  Northrop  time-domain  pilot  model.  Reference  3,  is  set  up  to  perform  this 
tracking  task  in  Just  the  way  the  pilot  does  it  as  described  above.  This  is  shown  in 
Figure  1.  There  will  be  two  forms  for  the  pilot  compensation  elevator  command 
one  which  provides  the  initial  target  acquisition,  and  the  other  after  time  D has  passed 
which  controls  final  precision  tracking  and  eliminates  steady  state  errors.  These  are 
of  the  forms 
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Figure  1.  Definition  of  Step  Target  Tracking  Task 

where  6.  is  pitch  angle  tracking  error  and  the  subscripts  I and  F refer  to  initial 
acquisition  and  final  tracking,  respectively.  The  term  repicesents  a pilot's 
avoidance  of  steady  state  error  by  means  of  integral  control.  A pilot  delay  of 
T = 0. 3 sec  will  be  used. 

The  following  quantities  must  be  adjusted  in  order  to  perform  a simulation  of  this 
step  tracking  task  for  the  evaluation  of  a given  aircraft  configuration: 

"^Lp' 

This  adjustment  is  performed  using  an  optimization  principle.  For  the  analysis  of 
step  target  tracking,  it  will  be  assumed  that  the  pilot  optimizes  time-on-target  and 
that  this  leads  to  the  best  compromise  of  rapid  target  acquisition  and  steadiness  of 
target  tracking.  The  adjustment  rule  for  the  pilot  model  is  thus:  choose  the  param- 
eters any  way  that  leads  to  maximum  time-on-target. 

PILOT  - AIRCRAFT  ANALYSIS  OF  LONGITUDINAL  STEP  TARGET  TRACKING 

One  of  the  most  familiar  and  widely  employed  guides  to  longitudinal  flying  qualities 
is  the  data  obtained  by  Neal  and  Smith  of  Cornell  Aeronautical  Laboratory  during  an 
in-flight  simulation  sponsored  by  the  Air  Force  Flight  Dynamics  Laboratory  in  1970. 

The  test  matrix  included  variations  in  short  period  frequency,  damping,  and  control 
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system  parameters.  Flight  test  evaluation  included  pitch  angle  tracking  of  both  random 
and  step  commands.  The  reported  pilot  ratings  and  piiot  comments  cover  stick  forces, 
predictability  of  response,  attitude  control/tracking  capability,  normal  acceleration  con- 
trol, effects  of  random  disturbances,  and  IFR  problems.  Most  pilot  comments  deal  with 
initial  response  ("predictability  of  response")  or  precision  attitude  tracking  control 
("attitude  control/tracking  capability"). 

Forty-two  configurations.  Series  1 through  7,  were  calculated  and  presented  in 
Reference  3.  A pipper  diameter  of  0. 005  radian,  a step  size  of  0. 2 radian,  and  a total 
tracking  time  of  5 seconds  were  adopted.  Since  the  system  was  linear,  any  choice  of 
step  and  pipper  size  that  preserves  the  40  to  1 ratio  will  lead  to  the  same  time-on- 
target  and  normalized  rms  9 statistics.  ■ 

Figure  2 shows  the  calculated  step  tracking  response  of  one  of  the  better  configur- 
ations surveyed,  7C,  which  was  given  a rating  of  PR  ^ 1.5.  in  this  case,  the  rapid 
acquisition  of  the  target  leads  to  low  rms  6.  while  the  steadiness  of  the  precision 
tracking  results  in  large  time-on-target.  On  the  other  hand.  Figure  3 shows  a poor 
configuration,  IF  (PR  = 8),  that  has  sluggish  response  indicated  by  high  rms  6^.  Even 
worse  is  the  inability  of  this  configuration  to  settle  out  on  the  target,  so  that  time-on- 
target  is  mostly  achieved  during  target  crossings.  Other  configurations  show  a wide 


0.4 


Kpi  - 70.0  Kpp  ' 66.0  TOT  ==  2.80 

T^i  -.05  T^f  ' 0 RMSOe  “ .32 

0 .5  K,c  - 0 PR  = 1.5 


Figure  2.  Configuration  7C  Step  Tracking  Response 
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Figure  3.  Configuration  IF  Step  Tracking  Response 

range  of  specific  handling  qualities  problems;  aircraft  that  exhibit  great  overshoot  and 
others  whose  steady-state  error  is  difficult  to  overcome,  even  with  the  use  of  the 
integral  control  compensation. 

The  primary  objective  of  the  flying  qualities  specifications,  called  out  in 
MIL-F-8785B,  is  to  establish  numerical  criteria  that  define  levels  of  performance  in 
terms  of  pilot  ratings:  Level  1 — PR  1-3. 5,  Level  2 — PR  3. 5-6. 5,  and  Level  3 — PR 
6. 5-9. 5. 

It  is  useful  to  examine  the  correlations  of  the  rms  ^ and  time-on-target  data 
calculated  for  the  Neal  and  Smith  configurations  with  pilot  ratings.  The  rms  e_  data 
are  presented  in  Figure  4.  The  expected  result  of  increasing  pilot  rating  number  with 
increasing  rms  9 is  clearly  shown.  However,  if  an  attempt  is  made  to  draw  ' specifi- 
cation  boundary  as  a vertical  line  at  some  rms  0^  value,  in  order  to  specify  the  per- 
formance in  Level  1 or  2,  the  result  is  that  no  lines  can  be  drawn  that  do  not  also  in- 
clude many  points  from  the  wrong  levels.  This  failure  of  rms  0 to  correlate  with 
pilot  ratings  sufficiently  well  for  specification  purposes  has  been  frequently  noted. 

From  the  description  of  the  piloted  task.  It  is  clear  that  the  rms  0 statistic  is  tnci- 
dental,  time-on-target  being  the  primary  performance. measure.  If  calculated  time- 
on-target  is  plotted  against  pilot  ratings,  there  is  again  a strong  correlation,  as  shown 
in  Figure  5.  Unfortunately,  this  correlation  is  even  less  able  to  furnish  specification 

boundaries  than  the  rms  0 vs  pilot  rating  data. 
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Figure  4.  Correlation  of  rms  0 with  Pilot  Ratings 
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Figure  5.  Correlation  of  Time-On-Target  with  Pilot  Ratings 
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COmiELATION  OF  STEP  TARGET  DATA  WITH  NEAL-SMITH 
PILOT  RATINGS 

From  the  above  it  is  clear  that  the  single  performance  parameters  rms  6^  or 

lime-on-target  are  not  sufficient  to  specify  acceptable  performaiice  of  the  Neal  and 

Smith  configurations*  If  one  considers  that  the  pilot  might  trade  rms  8 and  time-on- 

c 

target  against  one  another  in  generating  his  pilot  rating,  these  statistics  become  more 
useful*  To  see  how  this  trade-off  may  take  i>lace,  normalized  rms  0^  is  plotted  versus 
time-on- target  with  the  \yo\ni  indicated  by  the  minimum  pilot  rating  given  by  a test  pilot 
during  the  in-flight  simulation*  This  is  shown  in  Figure  6 along  with  apparent  boun- 
daries that  neatly  separate  the  regions  of  Levels  1,2,  and  3.  With  the  exception  of 
seven  )x>ints  out  of  forty-two,  all  configurations  lie  in  regions  bounded  by  apparent 
curves  that  illustrate  the  trade-off  between  the  two  performance  measures*  These 
curves  show,  for  example,  that  a pilot  will  tolerate  more  sluggish  response  in  a given 


Figure  6*  Pilot  Ratings  as  Functions  of  rms  9^  and  Time-On-Target 
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Level  if  the  resulting  time-on-target  is  especially  good,  and  conversely.  Since  the 
parameters  rms  6.  and  time-on-target  correlate  with  pilot  ratings  obtained  daring  a 
flight  test  program  that  examined  various  tracking  tasks,  the  representation  of  tai^et 
tracking  by  the  step  target  at^ears  to  be  justified. 

VALIDATION  OF  THE  STEP  TARGET  METHOD  USING  THE  F-5E  AIRCRAFT 

Further  validation  of  the  method  was  obtained  by  comparing  F-5E  aircraft  with 
and  without  control  augmentation  at  nine  flight  conditions  representative  of  the  primary 
maneuvering  envelope.  Full  data  is  given  in  Reference  3 from  which  the  examples 
shown  in  Figures  7 and  8 are  drawn. 

Comparison  in  Reference  3 of  the  step  tracking  responses  for  each  flight  condi- 
tion with  and  without  augmenter  shows  the  importance  of  proper  augmentation  for  good 
tracking  response.  In  the  augmented  cases,  the  initial  response  is  faster  as  reflected 
in  the  rms  tracking  error  statistic,  while  the  better  damped  dynamics  lead  to  larger 
time-on-target  values.  To  demonstrate  the  validity  of  the  boundaries  shown  in  Fig- 
ure 6 based  on  the  Neal-Smith  data,  die  F-5E  response  data  is  plotted  on  these 
boundaries  in  Figure  9.  Since  the  augmented  F-5E  has  good  Level  1 flying  qualities, 
while  the  unaugmented  aircraft  may  or  may  not  meet  Level  1 criteria,  the  Level  1- 
Level  2 boundary  is  consistent  with  the  F-5E  data.  In  this  way,  not  only  do  the  data  of 
Figure  9 show  the  gradient  direction  of  improving  performance  which  characterized  the 
Neal-Smlth  data,  but  the  actual  suggested  boundary  position  is  consistent  as  well. 


Kp,  = ' .49  Kop  " - .6  TOT  = 2.26 

Tli  ’ 3 Tlf  • .2  RMSdg  = .31 

0 ' .8  '^IC  " 0®  AUGMENTER 

Figure  7.  F-5E  Case  4 Step  Target  Tracking  Response 
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Figure  8.  F-5E  Case  4 Step  Target  Tracking  Response 


TIME  ON-TARGET  (SEC) 

Figure  9.  F-5E  Validation  of  Step  Target  Prediction  Method 
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YF-17  CONTROL  IMPROVEMENT  DESIGN  EXAMPLE 

Recently,  the  step  target  method  was  used  to  evaluate  and  study  possible  control 
configuration  Improvement  of  the  YF-17  aircraft.  The  baseline  aircraft  was  designed  to 
meet  the  Neal-Smith  flight  control  criteria,  but  a multi-parameter  perturbation  of  con- 
trol constants  has  led  to  improvements  in  predicted  tracking  performance.  Flight 
simulations  are  now  planned  to  verify  these  predictions,  which  involved  only  small  changes 
in  control  parameters. 

The  predicted  improvements  are  shown  for  a number  of  flight  conditions  in  Figure 
10.  Time-on-target  and  rms  tracking  error  are  plotted  against  the  boundaries  shown  in 
Figures  6 and  9.  The  tail  of  each  arrow  represents  the  baseline  YF-17  as  flight  tested, 
and  the  head  shows  the  predicted  response  of  the  aircraft  with  the  modified  control 
design.  It  is  clear  that  these  small  changes  in  the  control  parameters  have  produced 
substantial  improvements  in  the  predicted  tracking  performance.  It  should  also  be 
pointed  out  that  these  calculations  were  performed  using  the  full  nonlinear  YF-17  air- 
craft and  control  descriptions. 


Figure  10.  Predicted  Improvement  of  Baseline  YF-17 
Step  Target  Tracking 
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The  tracking  improvements  shown  in  Figure  10  were  calculated  using  the  same 
modified  control  parameters  in  each  case.  The  most  striking  of  the  time-on-target 
improvements  is  seen  by  comparing  the  baseline  step  response  shown  in  Figure  11  with 
the  modified  performance  shown  in  Figure  12.  The  flight  condition  for  this  case  is 
Mach  0.6  at  sea  level. 


Figure  11.  Step  Target  Tracking  Response  of  Baseline  YF-17 


Figure  12.  Step  Target  Tracking  Response  of  Modified  YF-17 
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SPECIFICATION  OF  AIR-TO-AIR  TRACKING  PERFORMANCE 

The  success  of  the  step  tai^et  tracking  prediction  method  allows  the  following  sug- 
gestions for  tracking  performance  specification.  For  a specification  to  be  a useful, 
discriminating,  and  fair  criterion  for  tactical  aircraft  procurement,  the  following 
items  must  be  satisfied: 

1)  The  specification  item  must  be  numerical. 

2)  The  specification  item  must  correlate  with  pilot  comments  and  pitot  ratings. 

3)  The  specification  item  must  be  easily  measured  in  flight  test  or  flight 
simulation. 

4)  The  specification  item  must  be  reliably  pre<'lctable  by  analytical  means  for 
use  in  early  design  and  development ' ..aatlon. 

5)  The  method  that  predicts  the  specification  item  must  be  applicable  in  a 
completely  standardized  form  that  evaluates  the  most  general  models  of 
the  candidate  aircraft  available. 

6)  The  specification  item  must  be  valid  for  ail  current  acceptable  aircraft,  and 
must  exclude  poor  or  unacceptable  aircraft. 

Unfortunately,  these  six  requirements  for  military  specification  criteria  have 
not  all  been  met  by  any  steady-state  approach  to  the  precision  tracking  problem. 
However,  the  transient  method  of  step  target  tracking  potentially  satisfies  these 
items.  In  particular,  the  step  target  method  has  the  following  characteristics  that 
correspond  to  the  requirements  llsted'above: 

1)  The  step  target  method  is  based  on  the  numerical  measures  of  rms 
tracking  error  and  time-on-target  as  shown  in  Figure  6. 

2)  The  two  measures  correspond  with  pilot  comments  in  the  following  way: 

rms  tracking  crrror:  Quickness  of  response  and  over- 

shoot characteristics 

time-on-target:  Steadiness  on  target  and  precision 

tracking  characteristics 

In  addition,  these  two  measures  strongly  correlate  with  pilot  ratings 
obtained  by  Neal  and  Smith. 
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3)  The  use  of  step  target  tracking  is  already  an  established  flight  test  pro- 
cedure. It  is  completely  standardized  and  easily  tested. 

4)  The  step  target  response  is  easily  predicted  for  longitudinal  step  target 
tracking,  and  the  extension  to  multiaxis  target  tracking  is  straightforward. 

5)  The  method  can  be  used  with  all  representations  of  candidate  aircraft  from 
linear  to  full  nonlinear  equations. 

6)  The  method  clearly  establishes  performance  boundaries  for  the  Neal-Smith 
and  F-5E  aircraft.  The  only  remaining  requirement  for  MIL-F-8785B  in- 
clusion is  further  validation  by  current  advanced  tactical  aircraft. 

FINAL  REMARKS 

Pilot  ratings  have  been  successfully  correlated  with  regions  in  the  two-dimensional 
space  having  calculated  rms  tracking  error  and  tlme-on-target  coordinates  for  the 
in-flight  simulation  data  obtained  by  Neal  and  Smith.  This  shows  the  generality, 
versatility,  and  practicality  of  time-domain  pilot  models.  By  demonstrating  analytically 
the  tradeoff  between  target  acquisition  and  precise  tracking  for  a short  tracking  period, 
the  interrelationships  of  pilot  ratings,  the  dynamics  of  pilot  control  compensation,  and 
discrete  maneuver  flight  test  procedures  are  made  clear.  Validation  by  F-SE  aircraft 
and  a control  improvement  design  study  of  the  YF-17  further  demonstrate  the  use  and 
practicality  of  the  method.  It  is  expected  that  future  research  into  multiaxis  step  tar- 
get tracking  will  yield  similar  correlations  with  flight  test  data.  In  the  meantime,  the 
time-domain  pilot  model  can  be  readily  used  to  evaluate  a wide  variety  of  continuous  and 
discrete  tasks  encountered  in  the  flying  qualities  of  modem  high  performance  aircraft. 
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SUMMARY 


The  influence  of  different  types  of  predictor  dlsplrys  In  a 
longitudinal  VTOL  hover  task  is  analyzed  in  a theoretical  study.  It  has  been 
assuaed  that  pitch  angle  and  position  will  be  presented  to  the  pilot  in 
separate  displays  namely  the  artificial  horizon  and  a position  display.  The 
predictive  information  is  csloulated  by  means  of  a Taylor  series.  The  future 
pitch  angle  is  extrapolated  0*7s  ahead  and  displayed  as  an  additional  bar, 
whereas  the  position  is  displayed  as  an  extrapolated  path  element.  This  path 
element  is  approximated  by  three  straight  line  segments,  l.e.,  three  future 
poaltion  values  are  oaloulmted  with  the  end  point  being  2.0s  ahead. 

From  earlier  experimental  studies  it  is  well  known  that  preciotor 
displays  improve  human  and  system  performance  and  result  in  reduced  human 
workload.  In  this  study,  the  optimal  control  model  is  used  to  prove  this 
effect  theoretically.  The  status  and  predictive  quantities  are  considered  as 
separate  observed  variables.  The  Taylor  series  coefficients  are  incorporated 
in  the  observation  matrix.  Also,  rate  information  included  in  the  movement 
of  the  position  and  pitch  angle  indication  is  represented. 

Several  oases  with  differing  amounts  of  predictive  and  rate 
information  are  compared.  The  results  show  the  expected  Improvements  in 
human  and  system  performance  in  terms  of  RMS-values.  The  strongest  influence 
is  caused  by  the  indication  of  the  extrapolated  path  element,  especially  the 
end  point.  Computed  cost  gradimits  and  fraotions  of  attention  show  the 
relative  importance  of  the  individual  pieces  of  displayed  information.  An 
optimization  of  the  attention  allocation  shows  a further  improvement  in 
system  performance  in  all  cases. 
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I Introduction 


Predictor  aisplays  have  been  investigated  intensively  in  laboratory 
simulations  Cl]-[5]>  It  has  been  found  that  they  improve  human  and  system 
performance  and  result  in  reduced  human  workload.  More  recently,  predictor 
displays  have  been  receiving  increasing  attention  (see,  e.g.,  [6])  because 
the  technology  of  computer  graphics  has  reached  a high  standard  [7]  which 
allows  one  to  implement  these  displays  more  easily  in  real  man-machine 
systems. 

During  the  last  few  years,  an  optimal  control  model  of  the  human 
operator  (see,  e g.,  [8],  [9])  has  been  applied  as  a unified  methodology  for 
analytical  display  design  and  evaluation  [10]-[13].  Attitude/director 
indicator  and  flight  director  displays  have  been  considered  as  examples. 

This  paper  is  a contribution  to  such  an  analytical  display  design  and 
evaluation  procedure*  Different  types  of  predictor  displays  in  a 
longitudinal  VIOL  hover  task  are  analyzed  theoretically  by  means  of  the 
optimal  control  model  of  the  human  operator.  Rather  than  fitting 
experimental  data,  the  purpose  here  is  to  calculate  the  expected  human  and 
system  performance  with  different  display  designs.  These  results  are 
validated  by  intuitive  reasoning  by  cwisidering  earlier  experimental  results 

In  the  next  section,  the  VTOL  hover  task  is  described.  The  assumed 
predictor-display  layout  is  explained  in  Section  III.  Section  IV  gives  a 
brief  overview  of  the  optimal  control  model  and  emphasizes  specific 
considerations  for  applying  this  model  to  the  utilization  of  predictor 
displays.  Finally,  the  results  of  a case  study  are  discussed  in  Section  V 

II  Description  of  the  VTOL  hover  Task 

The  task  chosen  in  this  paper  concerns  the  longitudinal  motion  of  a 
hovering  VTOL  aircraft.  For  comparison  purposes  the  task  is  the  same  as 
that  in  [14]  which  since  then  nas  also  been  considered  in  other  papers, 
e.g  ,[15J,  [163. 


Figure  1 : Series  Loop  Model  for  rilot 
Longitudinal  Control  in  Hover  (after  [15]) 
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Figure  1 shows  a possible  structure  of  this  man-madilne  system^  assuming  a 
series  loop  model  for  the  pilot  in  which  his  behavior  is  represented  by  the 
two  transfer  functions  and  Yp^ 


The  system  dynamics  of  the  aircraft  are  described  by  the  following 
equation  (see  also  Figure  2); 


Equation  (1)  includes  a first  oruer  lag  tiller  for  ueriving  the  longituainai 
gust  u-  from  a white  noise  source  w^  as  well  as  a first  order  lag  with  time 
constant  Tj  s 0 01s  limiting  the  control  rate  of  the  actuator.  The  main 
reason  for  the  second  lag  is  to  extend  the  state  vector  in  such  a way  that 
the  second  derivative  of  the  pitch  angle  is  also  a component  of  the  state 
vector.  This  is  needed  for  the  predictor  display  as  will  be  shown  later. 
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In  £quaticn  (t)  and  Figure  2*  g is  the  gravitational  constant  and  X^, 
Mu»  Mq,  are  aircraft  stability  derivatives.  Their  values  are  chosen  to  be 
the  same  as  in  the  nominal  case  in  [15],  namely 

Xy  = 0.13“'', 0.0207  ft“^s“',  Mq  = -3-0s“'',  = 0.431s“2, 

Also,  the  Simulated  gust  is  the  same  as  in  [15]-  The  bandwidth  of  the  gust 

filter  is  w.  s 0-314  rad.s"'  and  the  rms-value  of  the  gust  is  u_  = 5-14 

*rms 

ft.s”^,  i- e-#  .the  variance  of  the  driving  white  noise  is  = 16-59- 


Iir  Layout  of  Assumed  Predictor  Displays 

'Two  main  techniques  have  been  used  for  generating  predictor  displays. 
One  is  the  fast-time  model  technique  [33 » [4];  the  other  one  is  the 
extrapolation  technique  [2],  [53-  In  this  paper*  the  extrapolation  technique 
is  applied,  its  advantage  is  that  no  model  of  the  aircraft  needs  to  be 
implemented  and  run  repetitively,  faster  than  real  time*  to  generate 
predictions  on  the  basis  of  expected  control  inputs.  Instead*  the 
predictions  are  calculated  by  means  of  a Taylor  series  on  the  basis  of 
present  measurable  position,  rate,  and  acceleration.  The  only  disadvantage 
of  this  technique  is  that  it  might  be  difficult  to  gene*'ate  noise-free 
acceleration  information,  if  this  is  not  measurable- 

The  extrapolation  technique  is  used  in  the  present  study  to  predict 
extrapolated  longitudinal  position  x as  well  as  pitch  angle  0-  For  positicxi 
X the  predicted  value  is  calculated  as  follows: 

2 

. T 

Xpjj(t)  = x(t  + » x(t)  + x(t)  + -J-  X (t)  (2) 

The  corresponding  Taylor  series  expression  for  the  pitch  angle  d reads: 

2 

"^Pl,(t)  = (t  + Tq  ) » « (t)  + To  0 (t)  + ~ a (t)  (3) 

The  Taylor  series  expressions  of  Equations  (2)  and  (3)  are  truncated  after 
the  second  derivative  terms.  This  has  been  found  in  earlier  experimental 
studies  (see  [53)  to  be  a reasonably  good  approximation. 

It  has  been  assumed*  for  the  longitudinal  hover  task  studied  here*  that 
the  pilot  would  view  displays  with  predictive  information  like  those  shown  in 
Figure  3.  The  pitch  angle  and  position  information  is  separately  indicated 
in  two  displays.  The  one  for  the  pitch  angle  or  inner  loop  of  Figure  1 is 
like  one  dimension  of  an  artificial  horizon,  whereas  the  one  for  the  position 
or  outer  loop  of  figure  1 is  presented  as  a function  of  time.  Similar 
displays  have  been  studied  experimentally  in  [53  with  similar  system 
dynamics*  (dilch  allows  for  adopting  the  following  data.  A prediction  span  of 
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s 0>7s  seems  to  be  appropriate  for  pitch.  For  the  position,  the 
indicaticm  of  an  extrapolated  path  element  with  a prediction  span  showing  the 
range  between  the  actual  value  and  the  end  point  (see  Figure  3)«  i e.,  tV  s 
0...2S,  has  been  chosen.  The  curved  extrapolated  path  element  can  be 
approximated  by*  e.g.*  three  straight  lines  as  shown  in  Figure  3*  This 
reduces  the  calculation  of  the  path  element  to  that  of  three  points  in  the 
future  i.  e.»  (1/3,  ?/3,  and  ahead. 


— 0PD 

x(t) 

B Actual/ 

Value  ^ 

Reference 

Reference 

Predicted 

Value 

Figure  3:  displays  witii  Predictive  Information  for 
Indications  of  Pitch  Angle  (left)  and  Position  (right) 

IV.  Applicaticxi  of  the  Optimal  Control  Model 


In  this  paper  the  same  optimal  control  model  for  the  human  operator  has 
been  applied  as  in  [15].  In  the  block  diagram  of  Figure  4*  a distinction  has 
been  made,  however,  between  influences  of  display  parameters  and  human 
perceptual  abilities  on  the  observation  vector  y(t).  The  human  perceptual 
abilities  include  (1)  estimation  in  the  sense  of  extracting  the  first 
derivative  of  a displayed  variable  from  its  movement  as  well  as  (2) 
perceptual  thresholds  for  the  position  and  rate  of  displayed  variables.  For 
this  study  all  thresholds  have  been  assumed  to  be  zero* 


figure  h:  uptimal  Control  Model  for  the 
Human  Operator  (after  [15]  and  [9]) 


For  reasons  of  comparing  the  results  of  this  paper  with  those  of  [15]* 
the  same  parameters  of  the  human  operator  model  and  the  cost  functional  have 
been  adopted,  whereas  the  aircraft  dynamics  are  those  described  by  Equation 
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(1),  i.ei. , having  only  the  very  slight  change  mentioned  before.  The  cost 
Ajnctional  for  optimal  control  is 

J = + 400  + g 6^  (^) 

i.e.j  a weigiitej  ru'i:  ox  tne  fx-an  iVioarevi  ci  fno  position  x,  the  pitch 

rate  q s $ . and  the  control  rate  The  time  delay  of  the  human  operator' 

model  is  T = 0.15s,  and  the  lag  time  constant  of  the  neuromuscular  system  is 
adjusted  to  s^.O.ls  by  an  appropriate  choice  of  ^ in  Equation  (H)>  i.e.,  'g 
s 0.03*  The  noise«to>signal  ratio  of  the  motor  noise  is  = -25d6.  The 
noise-to-signal  ratios  of  the  observation  noises  change  in  this  study. 
However-  for  the  baseline  display  format  with  the  same  observation  vector  y.  = 
tx,u,e,q. ]”  as  in  [15]»  they  are  adopted  as  = ^3  = -20dB. 

The  described  optimal  control  model  should  be  able  to  explain  the 
improvements  of  human  and  system  performance  which  occur  when  predictor 
displays  are  used.  Looking  at  Figure  3*  one  can  see  that  all  status  and 
predictive  information  can  be  described  by  the  following  observation  vector: 


P 


thich  can  be  expressed  in  terms  of  position  x and  pitch  angle  0 as  well  as 
the  first  and  second  derivatives  of  both  variables  by  applying  Equations  (2) 
and  (3).  The  observation  vector  in  Equation  (5)  considers  also  rate 
information!  namely  u s x and  q s d as  in  the  baseline  display  format* 
thereby  coohining  the  two  influences  of  display  parameters  and  human 
perceptual  abilities  of  Figure  4. 
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As  the  observation  vector  is  normally  derived  from  the  state  vector,  the 
vector  on  the  ri^ht  side  of  Equation  (5)  composed  of  position  x*  pitch  angle 
9 and  its  first  and  second  derivatives  has  to  be  expressed  in  terms  of  the 
state  vector.  All  these  components  appear  in  the  systems  equation  (1)  and  in 
Figure  2,  The  mathematical  description  is: 
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(6) 


Taking  Equations  (5)  and  (6)  together  results  in  the  following  equation  for 
the  observation  vector; 

y*P*T»x  = C»x  (7) 


Equation  (7)  shows  uiac.  a matrix  nuitiplication  is  necessary  to  find  the 
observation  matrix  C.  One  of  the  two  matrices  being  multiplied > i.e.,  P, 
reflects  the  display  format  and  the  human  perceptual  abilities,  whereas  the 
other  one,  i.e.,  T contains  mainly  components  of  the  systems  matrix  A*  • 

In  order  to  investigate  the  influence  of  different  amount  of  predictive 
and  rate  information,  a theoretical  case  study  with  the  optimal  control  model 
has  been  run.  The  13  cases  studied  differ  only  in  their  observation  vectors 
which  are  chosen  as  shown  in  Table  1.  Available  information  is  denoted  by  a 
*1”  whereas  a **0*  means  that  this  component  of  the  observation  vector  is  not 
present  in  the  corresponding  case. 
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Table  I 

Composition  of  the  Observation  Vectors  for  the  Case  Study 


A 

B 

c 

0 

E 

F 

G 

H 

I 

J K 

L 

M 

X 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 1 

1 

1 

u 

1 

0 

0 

1 

1 

0 

0 

1 

0 

0 1 

1 

0 

*1/3PD 
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0 

0 

0 

0 

0 

0 

0 

0 

1 1 

1 

1 

^2/3PD 

0 

0 

0 

0 

0 

0 

0 

0 

0 

1 1 

1 

1 

*PD 
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0 

0 

0 

0 

0 

0 

1 

1 

1 1 

1 

1 

e 

1 

1 

1 

1 

1 

1 

1 

1 

1 

1 1 

1 

1 

q 

1 

1 

0 

0 

1 

1 

0 

1 

0 

0 1 

1 

0 

0 

0 

0 

0 

1 

1 

1 

0 

0 

0 0 

1 

1 

Case  L is  identical  with  Equation  (5).  From  this,  all  others  have  been 
derived  by  omitting  a certain  amount  of  information*  i.e.,  deleting  the 
corresponding  rows  in  the  observaticm  vector  and  observation  matrix. 


Cases  At  E»  C»  and  D are  concerned  with  the  influence  of  rate 
information  which  has  also  been  investigated  in  [I?].  Case  A is  the  baseline 
display  format  of  this  study  and  is  the  same  as  in  [15].  Cases  E,  F,  and  G 
consider  only  predictive  pitch  information,  whereas  cases  H#  It  J*  and  K 
assume  only  predictive  position  information*  being  either  only  the  end  point 
(Htl)  or  the  complete  extrapolated  path  element  (J*K).  Finally,  cases  L*M 
include  both  predictive  pitch  and  position  information. 


The  case  study  is  carried  out  using  the  version  of  the  optimal  control 
model  which  is  described  in  [18].*  This  includes  an  optimization  of  the 
fractions  of  attention  the  pilot  devotes  to  the  individual  pieces  of 
displayed  Information*  The  optimization  technique  based  on  the  cost 

gradients  of  all  pieces  of  information  is  described  in  more  detail  in  [19]. 
The  observation  noise-to>signal  ratio  of  the  ith  observed  variable  is 
related  to  its  fraction  of  attention  f) 


P 


i 


with 


^ total 


(8) 


tliere  Pq  is  the  full  attention  noise-to-signal  ratio*  normally  -20  db  [10]. 
Thus  the  above  mentioned  noise-to-signal  ratios  of  -20dB  for  all  four 


• The  authors  are  gratefUl  to  Aerospace  Systems,  Inc.*  Burlington*  Hass.,  and 
Vdlliam  C.  hoffman  in  particular  for  furnishing  the  optimal  control  model 
software . 
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observed  variables  in  the  baseline  display  format  correspond  to  a total 
attention  of  4.  The  value  of  4 is  the  baseline  for  full  attention  and  should 
not  be  Interpreted  as  the  human  operator  devoting  4 times  his  full  attention 
to  the  task. 

V Results 


Performance  scores  have  been  shown  in  Figures  5 and  6 for  all  13 
cases.  These  correspond  to  a total  attention  of  4,  with  attention  allocatim 
optimized.  RMS<-longltudinal  and  pitch  errors  have  been  plotted.  They  are 
discussed  in  some  detail  here.  For  both  variables*  positim  x and  pitch 
angle  0 certain  trends  are  apparent.  The  error  is  reduced  in  all  cases  when 
prediction  information  is  presented  (cases  E-H).  mere  is  an  increase  in 
RhS-errors  when  the  rate  information  is  not  available  (without  prediction  ; 
see  cases  A«D). 


Figure  5:  RMS-Longitudinal  Errors  Figure  6;  RMS-Pitch  Errors 

(for  all  13  Cases  with  Optimized  Attention  Allocation) 


For  the  longitudinal  positicxi,  the  absence  of  derivative 
information  for  position  and  pitch  (C)  results  in  about  80K  Increase  in 
RMS-error.  When  only  rate  u is  removed  (B),  the  error  increases  by  about 
50jl>  whereas  the  increase  is  only  about  33%  when  the  pitch  rate  is  absent 
(D).  Therefore,  it  is  very  important  that  the  displays  are  designed  to 
easily  allow  the  human  operator  to  make  good  rate  estimates. 

Compared  with  the  base  line  performance  (A),  the  reduction  in  RMS-error 
is  rather  small  when  only  the  pitch  angle  predictor  is  available  (E).  The 
error  is  reduced  by  about  20^.  With  predictor  information*  lack  of  pitch 
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rate  does  not  have  much  effect  (see  G vs.  P),  presumably  due  to  the  rate 
informatl(Xi  contained  implicitly.  When  rate  u is  not  available  (F»G) , the 
HMS-error  is  reduced  only  slightly  compared  with  A even  when  prediction  is 
available  for  pitch.  However-  when  B and  C are  compared  to  P and  G 
respectively,  the  error  is  reduced  by  35  to  50>  with  the  addition  of 
predictor  information. 

It  is  significant  to  observe  that  the  lack  of  rate  informatl<» 
does  not  affect  the  results  when  the  position  predictor  display  is  available* 
This  is  seen  in  H and  I having  nearly  equal  performance  scores.  Fran  the 
baseline  performance  (A),  a reduction  in  RMS-error  of  about  45$  is  observed* 
It  is  also  important  to  note  that  compared’  to  C,  the  addition  of  position 
prediction  alone  reduces  the  error  to  less  than  1/3  of  its  original  value* 
This  is  validated  by  intuitive  reasoning  based  on  earlier  experimental 
results  [5]*  With  the  predictor  for  a two-dimensional  map  display,  it  was 
found  that  the  lap  time*  i.e. , for  one  circuit  of  the  map,  was  reduced  by 
32$. 


When  the  position  predictor  is  available,  all  the  cases  (H-M) 
result  in  about  the  same  RMS-errors.  This  happens  irrespective  of  whether 
the  position  and  pitch  rates  and  the  attitude  predictor  information  are 
available*  This  confirms  our  belief  that  it  is  more  Important  to  employ 
predictor  display  aiding  for  the  slower  time  constant  outer  loop.  An 
unexpected  result*  however*  is  the  fact  that  additional  intermediate  points 
of  the  extrapolated  path  element  (J-M)  do  not  further  improve  performance. 
The  most  important  predictive  Information  seems  to  be  the  indication  of  the 
end  point  of  the  extrapolated  path  element. 

The  trends  for  the  pitch  angle  error  are  similar  to  the 
longitudinal  position  error*  When  all  derivative  information  is  removed  (O* 
the  error  increases  by  about  50$ * Absence  of  u (B)  results  in  a 23$ 
Increase*  whereas  for  the  pitch  rate  (D)  the  corresponding  increase  is  about 
30$.  The  order  of  B and  D is  reversed  with  respect  to  position  error*  as 
could  be  expected.  The  pitch  angle  predictor  reduces  the  error  by  about  10$ 
(E).  Loss  of  pitch  rate  infoimiatiai  is  not  important  when  the  predictor  is 
available  (G  vs.  F).  These  results  are  in  qualitative  agreement  with 
earlier  experimental  results  [53  , where  fiMS-errors  have  been  improved  by  ^ 
factor  of  2-4  with  the  addition  of  a predictor  for  an  artificial  horizon  in  a 
pure  attitude  control  task*  Further  reduction  in  RMS-pitch  error*  by  23$, 
occurs  when  the  position  predictor  display  is  added  (H-M).  This  is  a 50$ 
reduction  compared  to  the  no-derivative  case  (C).  As  before*  no  substantial 
difference  occurs  if  the  rate  information  or  intermediate  points  are  removed 
when  the  position  predictor  display  is  available. 
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f>igure  7:  Optimized  Fractions  of  Figure  8:  Optimized  Fractions  of 

Attention  for  Cases  A £ C D Attentim  for  Cases  E F,G  K,I 

For  all  13  cases  • the  optimized  fractions  of  attention  are 
plotted  in  Figures  7* 8* and  9*  7he  total  attention  is  constant  at  A for  all 
cases*  normalized  to  1 in  the  figure*  assuming  that  the  human  operator  will 
not  increase  his  effort  with  additionally  displayed  Information.  For  each 
displayed  variable  fractlcms  of  attenticm  are  shown  which  result  in  minimum 
total  cost.  Vihen  rate  Information  is  available*  the  optimum  fraction  of 
attention  required  is  more  (mostly  by  about  8 to  10  times)  for  the  rate  than 
for  the  corresponding  displayed  variable  itself,  i.e.,  position  or  pitch 
angle  (Figure  7)- 

With  no  predictor*  the  inner  loop  (see  Figure  1)  demands  more  attention 
(by  about  4 times  more  than  the  outer  loop),  when  rate  u is  not  available 
(cases  B C).  With  the  addition  of  the  predictor*  position  or  pitch  or  their 
derivatives  require  comparatively  less  attention  than  the  predicted 
variables.  The  predictor  requires  3 to  15  times  more  attention* 

Total  attention  for  the  position  predictor  is  about  2 to  3 times 
greater  than  that  for  the  pitch  predictor  (Figure  9).  From  this  and  the 
discussions  for  BMS-errors*  the  Importanoe  of  the  position  predictor 
information  is  obvious. 

It  should  be  pointed  out  that  for  constant  total  attention,  the 
BHS-errors  are  still  small  even  when  the  information  available  is  limited  ( 
e g. , only  3 variables  in  case  1 compared  to  8 in  case  L ),  as  long  as  the 
position  predictor  is  available.  This  could  be  due  to  less  noise  in 
observing  what  is  available  and,  hence  the  possibility  for  better  state 
estimation.  From  the  foregoing  discussions  it  is  clear  that  the  rate 


247 


int'ormatlof)  Is  highly  useful  when  a predictor  is  not  available.  Having  a 
predictor  for  the  low  speed  outer  loop  is  more  Important  for  performance 
since  it  reduces  the  RMS-errors  more  effectively. 


t'igure  9:  Optimized  Fractions  of 
Attention  for  Cases 

In  Figure  10,  the  RMS-values  of  position*  pitch  angle*  and  control  for 
different  cases  with  and  without  rate  and  predictor  information  are  plotted 
corresponding  to  optimized  attention  allocation.  These  cases  have  been 
chosen  because  the  additional  indication  of  the  end  point  of  the  extrapolated 
path  element  (K)  compared  with  the  baseline  display  format  (A)  resulta  in  the 
simplest  predictor  display  design  with  the  maximum  performance  improvement* 
Compared  with  these  two  cases*  C and  I show  the  influence  of  the  omitted  rate 
information*  The  tiends  discussed  earlier  are  seen  again  in  Figure  10* 

The  effects  of  varying  the  total  attention  and  optimizing  the 
attention  allocation  are  illustrated  for  RMS-longitudinal  errors  for  the 
oases  A,Cth*  and  I (Figure  11).  The  first  bar  in  each  case  corresponds  to 
variable  total  attention  split  equally  among  displays  (1  for  each  observed 
variable}*  For  the  second  bar,  total  attention  is  4*  split  equally  between 
the  inner  loop  and  the  outer  loop*  and  equally  among  displays  in  any 
particular  loop.  The  remaining  bar  corresponds  to  a total  attention  of  4, 
split  optimally.  The  errors  are  reduced  by  18|  for  case  A*  For  case  C*  a 
reduction  of  about  30S  occurs  when  total  attention  changes  from  2 to  4* 
Optimization  reduces  this  further  by  only  The  slight  increase  of 

RMS>error  in  case  H is  due  to  a decrease  in  total  attention  from  5 to  4* 
However,  in  case  1*  the  increase  in  total  attention  from  3 to  4 does  not 
change  the  KMS- value.  Vihen  attention  is  optimized,  up  to  30%  reduction  in 
error  is  obtained. 
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figure  10:  KHS^values  of 
Position  X,  Pitch  Angle  9 , and 
Control  fg  for 
Cases  A,C>H»1  with  Optimized 
Attention  Allocation. 
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Figure  11:  }81S«Longltudinal  Errors 
For  Cases  A,C,H,1  with  Variable 
and  Constant  Total  Attention. 


It  is  necessary  to  point  out  that  the  fractions  of  attention 
obtained  may  not  be  the  globally  optimum  values,  hue  to  the  coupling  between 
inner  and  outer  loop  and  the  interdependence  of  prediction  and  rate 
information  (see  Figure  2 and  Equations  2 and  3)*  different  combinations  of 
initial  conditions  lead  to  different  optimal  attention  allocations  with 
similar  total  cost  values.  This  corresponds,  however,  to  the  freedom  the 
human  operator  has  also  in  choosing  between  equally  appropriate  combinations 
of  interrelated  information.  The  optimized  fractions  of  attention  shown  in 
this  paper  seem  to  be  typical  values  found  with  different  initial  conditions. 


VI  Conclusions 

Predictors  improve  man-ma chine  system  performance  as  shown  by 
the  model  results  of  this  study.  This  is  consistent  with  the  results 
obtained  eg.,  in  (53.  The  position  predictor  display  is  more  useAil  in 
reducing  the  RMS-errors.  Especially*  the  end  point  of  the  extrapolated  path 
element  has  the  strongest  influence.  Due  to  slower  dynamics  § it  is  possible 
that  the  human  finds  it  difficult  to  infer  the  longitudinal  position  rate 
uompared  to  pitch  rate. 
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Tbe  addition  of  a predictor  might  result  in  reduced  workload  as 
evidenced  by  the  smaller  8(&*control  movements.  The  control  actions  by  the 
pilot  are  guided  by  the  predictor.  This  could  also  have  an  effect  on  the 
internal  model  because  estimation  of  the  states  is  aided  by  the  predictor 
display.  The  accuracy  requirements  of  the  state  predictor  implicitly 
included  in  the  optimal  control  model  of  the  human  operator  might  be  relaxed. 
The  improvement  of  state  estimation  with  an  even  inaccurate  internal  model 
might  also  be  important  for  monitoring  and  supervisory  control  tasks. 
Separate  studies  are  needed  to  evaluate  this  effect. 

The  study  shows  that  the  optimal  control  model  is  suitable  for 
analytical  predictor  display  designs.  Using  this  methodology  it  is  possible 
to  investigate  the  effects  of  certain  display  parameters*  e.g. » to  find  the 
optimal  length  of  the  prediction  span,  nils  may  allow  one  to  avoid  expensive 
mBn-ln»the>loop  simulation  studies. 
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SUMMARY 


A hierarchy  of  strategies  were  postulated  to  describe  the- process  of 
learning  steering  control.  Vehicle  motion  and  steering  control  data  were 
recorded  for  twelve  novices  who  drove  an  instrumented  car  twice  a week  dur- 
ing and  after  a driver  training  course.  Car-driver  describing  functions  were 
calculated,  the  probable  control  structure  determined,  and  the  driver-alone 
transfer  function  modelled.  The  data  suggested  that  the  largest  changes  in 
steering  control  with  learning  were  in  the  way  the  driver  used  the  lateral 
position  cue. 


INTRODUCTION 


Various  aspects  of  driver  behavior  have  been  studied  using  manual  control 
theory.  To  date,  most,  if  not  all,  of  this  research  has  used  experienced 
drivers.  The  research  to  be  described  in  this  paper  used  inexperienced  drivers 
in  order  to  study  the  changes  in  the  driver  describing  function  as  a novice 
learns  to  steer  a car. 

The  mathematical  model  used  to  describe  the  driver  is  the  crossover  model, 
described  in  Reference  1.  Though  the  model  was  developed  using  single-loop, 
compensatory  tracking  tasks,  it  has  been  successfully  used  to  describe  car 
driving  where  two  loops  are  involved.  The  basic  tenet  of  the  crossover  model 
is  that  the  human  adapts  to  each  controlled  element  so  that  the  open  loop  man- 
machine  transfer  function  always  has  the  form: 

Yp(jw)Y^(jw)  = w^e"^’^'^  (1) 

”jw 

♦Work  sponsored  by  the  National  Research  Council  of  Canada  and  drawn  from 
principal  author's  Ph.D.  dissertation  completed  at  the  U.  of  Waterloo,  Canada. 
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where  w is  the  system  crossover  frequency,  and  t is  the  effective  time  delay 
(incorporating  delays  due  both  to  the  operator  and  the  control  device),  Yp 
is  the  operator  describing  function,  Y is  the  transfer  function  describing 
the  control  device  dynamics,  and  jw  is  the  complex  frequency  variable. 


Weir  and  McRuer  (Reference  2)  applied  this  model  to  automobile  lane- 
keeping steering  tasks  in  order  to  determine  which  of  the  available  visual  cues 
would  yield  good  performance  without  great  effort  on  the  part  of  the  driver. 
From  previous  studies  with  the  crossover  model  it  has  been  shown  that  the  human 
operator  selects  from  the  possible  cues  or  feedbacks  those  that  minimize  his/ 
her  equalization  requirements.  In  other  words,  the  operator  prefers  to  act  as 
a simple  gain  and  time  delay  rather  than  as  a single  or  double  differentiator, 
and  selects  cues  so  that  s/he  can  do  this.  The  car  dynamics  in  lateral  posi- 
tion are  such  that  the  use  of  lateral  error  as  a cue  would  require  the  operator 
to  act  as  a differentiator,  (y  j from  the  crossover  model.) 


This  eliminates  lateral  error  as  a dominant  cue  for  the  experienced  driver. 
Heading  angle  and  rate,  path  angle  and  rate,  and  time-advanced  lateral  devia- 
tion were  studied  (Reference  2)  as  possible  cues.  As  heading  rate  control 
allows  a fairly  large  lag  and  produces  a high  crossover  frequency,  it  appears 


to  be  the  best  cue  to  use.  As  its  use  is  associated  with  high  frequency  con- 
trol movements,  heading  angle  (an  intermediate  frequency  cue)  is  a more  probable 


cue  in  less  demanding  situations.  Control  is  unlikely  to  be  purely  directional 
since  drifts  in  lateral  position  will  occur  which,  if  uncorrected,  may  result 
in  the  car  going  out  of  the  lane.  Therefore,  it  was  suggested  that  a probable 
structure  for  an  experienced  driver  is  an  outer  loop  controlling  lateral  posi- 
tion and  an  inner  loop  controlling  heading  angle  or  rate.  The  heading  angle 
inner  loop  provides  the  path  damping  necessary  for  a stable,  well-behaved 
closed  loop  system  - and  thereby  avoids  the  necessity  of  the  operator  differ- 
entiating the  input  (which  would  difficult  because  it  must  be  done  at  low  fre- 
quencies as  well  as  high)  which  would  be  needed  to  stabilize  the  outer  loop, 
if  it  were  the  only  loop  closed.  Though  a single  loop  structure  of  time  ad- 
vanced lateral  deviation  had  also  been  suggested  in  Reference  2,  the  time  ad- 
vance (preview  time)  necessary  for  such  a control  loop  to  work  was  in  the 
order  of  5 to  10  seconds.  Below  these  values  the  lead  generated  by  using  pre- 
dicted future  lateral  deviation  'would  not  compensate  sufficiently  for  the 
inherent  lags  in  the  driver/vehicle  system'.  In  Reference  3 a survey  is 
presented  of  the  research  on  estimated  preview  times  used  by  experienced  dri- 
vers. Only  when  the  driver  viewed  the  road  through  a narrow  slit  were  preview 
times  in  the  range  needed  for  good  use  of  time  advanced  lateral  deviation  as 
a control  loop.  This  suggests  that  such  a control  loop  is  an  unlikely  possi- 
bility under  normal  driving  conditions.  The  reade**  must  be  cautioned  at  this 
point  that  statements  about  which  cues  are  used  ih  driving  in  no  way  imply 
that  these  cues  are  directly  perceived  by  the  driver.  For  example,  the  driver 
may  perceive  heading  angle  directly  or  may  perceive  some  function  of  heading 
angle.  The  mathematical  analysis  cannot  differentiate  between  two  such  depend- 
ent variables. 
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Hypotheses  About  Learning  Steering  Control 

Perceptual -motor  learning  studies,  eye  movement  studies  of  novice  drivers 
and  anecdotal  information  obtained  from  driver  instructors  were  used  to  gen- 
erate hypotheses  about  the  stages  in  the  learning  of  steering  control.  In  the 
first  stage  it  was  postulated  that  the  driver  controls  lateral  position  (y), 
the  most  obvious  cue.  In  reference  4 it  was  shown  through  a study  of  the  eye 
movements  of  novice  drivers  that  novices  tended  to  look  closer  in  front  of  the 
vehicle  than  experienced  drivers,  suggesting  they  were  looking  for  lateral 
position  cues.  As  was  pointed  out  earlier,  lateral  position  is  a difficult 
cue  to  control  so  this  stage  was  not  expected  to  last  long  (see  Fig.  1). 

With  experience  the  novice  begins  to  look  further  ahead  of  the  car.  This 
is  necessary  in  order  to  better  monitor  the  environment  but  also  allows  the 
driver  to  pick  up  heading  angle  (t|))  movements  more  easily.  The  car's  dynamics 

in  heading  angle  (6^^^)  rate  dynamics,  so  that  the  driver's  control  may  be 

modelled  by  a simple  gain  and  time  delay.  Thus  the  second  stage  is  that  the 
driver  will  use  heading  angle  as  the  dominant  cue,  but  will  still  control  lateral 
position  directly  (as  in  the  first  structure),  with  corrections  being  made 
when  a significant  lateral  position  error  has  accumulated.  An  analogous 
strategy  was  used  by  subjects  in  an  experiment  described  in  reference  5,  where 
subjects  using  an  oscilloscope  centered  a target  on  crosshairs  by  sequentially 
pressing  two  keys,  one  causing  target  acceleration  to  the  right  and  the  other,, 
to  the  left.  The  response  pattern  suggested  that  some  subjects  modified  their 
responses  on  the  basis  of  feedback  i.e.  after  drifting  off  target  they  made  a 
single,  long  duration  corrective  movement,  while  other  subjects,  who  maintained 
a higher  rate  of  responding  and  were  consistently  better  in  overall  performance, 
used  a more  efficient  strategy.  These  latter  subjects  'when  the  target  drifted 
off  center  to  the  left.. .maintained  a high  rate  of  responding  but  at  the  same 
time  gradually  increased  the  length  of  time  the  right  key  was  active  relative 
to  the  left  key,  so  that  over  a series  of  responses  the  target  was  made  to 
drift  back  towards  the  center'.  It  was  postulated  that  at  an  intermediate 
stage,  learning  drivers  would  be  using  a strategy  similar  to  Pew's  first 
group  of  subjects,  which  would  be  represented  by  an  alternating  operation  on 
lateral  position  and  heading  angle  as  shown  in  Fig.  2. 

In  the  final  stage  of  learning,  it  was  postulated  that  the  driver  would 
begin  to  use  dual  loop  control,  where  heading  angle  is  the  dominant  cue,  con- 
trolled by  an  inner  loop,  and  lateral  position  is  controlled  with  an  outer 
loop.  In  this  way  lateral  position  may  be  controlled  by  heading  angle  cor- 
rections i.e.  using  a simple  gain  (Y^  = K^)  rather  than  having  to  estimate 

rate  of  change  of  lateral  position.  The  operators  control  of  heading  angle 
was  modelled  by  a gain.  Kip,  a lead  term  (1  * T^jw),  and  a time  delay 

(e"jWT)^  (i.e.  = K^(l  + T^  jw)e"^'*^).  The  lead  term  is  needed  to  offset 

a lag  in  vehicle  response  at  higher  frequencies.  For  the  experimental  car  the 
break  frequency  of  this  lag  occurred  at  T^  = 9.4  rad. /sec.,  therefore  the  same 

value  was  assumed  for  T^  when  the  driver-alone  transfer  function  was  modelled. 

In  reference  6 it  was  shown  that  this  structure  satisfied  the  crossover  model 
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and  appeared  to  provide  a reasonable  fit  to  experimental  data.  Such  a form 
of  control  is  analogous  to  that  used  by  the  subjects  using  the  more  efficient 
strategy  in  the  experiment  described  in  reference  5. 


Theoretical  Analysis 


The  driver-car  transfer  function  for  the  control  s,tructures  postulated  as 
stages  in  the  learning  process  will  now  be  derived. 

. Using  Fig.  1,  the  following  relationship  may  be  obtained; 

W"V‘w  ®«wVs'''®swVs 


Fig. 
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Vc  i 

1 > r 

L_lJ 

. Single-loop  control  of  lateral  pdsi- 
6swa-steering  wheel  angle,  6w-front  tire 
angle,  Gs-steering  gain,  other  definitions  in 
text) 


If  each  variable  is  cross-correlated  (see  reference  7 for  a description  of 
these  techniques)  with  the  input  disturbance,  6^,  the  following  is  obtained: 

+ 4,  6 - 4 . Y G - 4,  S^Y  G^  -(3) 


The  remnant,  n,  is  by  definition  that  part  of  the  drivers  output  which  is  un- 
correlated with  the  input,  so  that  4.  „ may  be  considered  to  be  zero.  Because 

®d"- 

is  such  designed  so  that  it  is  much  larger  than  n,  4^^^  will  be  negligible  in 


comparison  with  4.  , and  4,  . , 
®d^w  ^d^d 


Equation  (3)  is  then  reduced  to: 

(4) 


^^d'^d  ^^d*w  . r G 

♦*d«d  " 

For  structure  2 this  expression  is  equal  to  ^y®s*^  depending  on 

which  loop  is  in  use.  For  the  dual-loop  structure  3 this  expression  becomes: 


'd°d 


- h 


0 w ^ Y 
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Fig.  2.  Parallel  loop  control  of  heading  angle  and  lateral  position 


Fig.  3.  Dual  loop  control  of  heading  angle  and  lateral  position 

Thus,  no  matter  which  structure  the  driver  is  using,  the  same  cross  spec- 
tral expression  is  calcuT.clted  to  obtain  the  car-driver  transfer  function.  How- 
ever, as  will  now  be  shown,  the  form  of  the  transfer  function  obtained  differs 
depending  on  which  structure  is  in  use. 


In  the  first  two  structures,  either  heading  angle  or  lateral  position 
is  being  controlled  at  any  one  time.  Thus  the  first  two  structures  are  single 
control  loops  which,  in  the  frequency  range  used  in  this  study,  may  be  expected 
to  conform  closely  to  the  crossover  model.  Therefore,  using  equation  (1),  the 


car-driver  transfer  will  have  the  form  ^ e”'^'^^/jw 


When  this  function  is 


plotted  on  a Bode  plot  (amplitude  and  phase  vs.  frequency)  the  amplitude  slope 
is  20db  per  frequency  decade  (see  Fig.  4). 


The  values  assumed  for  the  driver's 
transfer  functions  in  the  third  structure 
were  such  that  the  car-driver  transfer 
function  could  be  modelled  at  mid-  and 
high  frequencies  (i.e.,  near  crossover 
frequency)  by  the  crossover  model,  as  in 
the  first  two  structures.  However,  the 
presence  of  the  outer  loop  operating  on 
y,  affects  the  expected  amplitude  slope 
of  the  Bode  plot.  Using  equation  (5), 
witcq.  as  frequency  increases,  the  ratio 
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frequencies,  where  it  causes  an  increase  in  the  amplitude  slope  as  seen  in 
Figure  4.  thus  structure  3 may  be  distinguished  from  structures!  and  2 by  the 
presence  of  an  increased  slope  in  the  Bode  amplitude  plot  of  the  car-driver 
transfer  function.  Structures  1 and  2 must  be  distinguished  from  each  other 
by  more  subtle  cues,  however.  Because  of  the  change  in  operator  requirements, 
a change  from  control  of  lateral  position  to  dominant  control  of  heading  angle 
would  result  in  a jump  in  crossover  freqeuncy  and  an  increased  phase  angle  at 
low  frequencies.  (The  difficulty  of  generating  the  low  frequency  lead  needed 
for  lateral  position  control  results  in  a pronounced  phase  droop  at  low  freq- 
uencies and  a lower  crossover  frequency.) 

The  considerations  discussed  above  were  used  to  help  determine  the  control 
structure  used  by  the  subjects. 


EXPERIMENTAL  PROCEDURE 


Subjects 

To  test  the  hypothses  about  changes  in  steering  control  with  learning, 
twelve  novice  drivers  participated  in  an  experiment  using  an  instrumented  car 
over  a five  week  period.  The  subjects  were  all  high  school  students  who  at  the 
start  of  the  experimental  test  period  were  beginning  a three  week  intensive 
driver  training  program.  They  were  selected  on  the  basis  of  having  had  minimal 
experience  of  driving.  Three  subjects  had  never  driven  a car  before  being  re- 
corded driving  the  instrumented  car  and  the  other  subjects  had  driven  on  at 
most  five  previous  occasions.  The  subjects  were  tested  on  nine  separate 
occasions  over  the  five  week  period. 


Equipment 

The  instrumented  car  driven  by  the  subjects  was  capable  of  recording 
driver  control  measures,  vehicle  motion  variables  and  vehicle  lane  position, 
and  was  built  by  Systems  Technology  Inc.,  Los  Angeles,  and  lent  to  this  author 
by  the  U.S.  National  Highway  Traffic  Safety  Administration.  The  car  is  described 
in  detail  in  an  STI  technical  tnanuial  (Klein  et  al,  1976).  Two  features  of  • 
particular  interest,  though,  are  the  lateral  position  detector  and  the  servo 
control . 

The  lateral  position  detector  was  developed  by  the  Institute  for  Perception 
in  the  Netherlands.  It  consists  of  a position  transducer  and  a control  unit. 

The  position  tranducer  uses  a rotating  prism  to  scan  the  intenstiy  of  reflected 
light  in  a lateral  plan  across  the  road  and  reflect  the  light  in  a photoam- 
plifier, Any  marker  which  sufficiently  contrasts  with  its  surroundings  is 
taken  as  being  part  of  the  reference  line  by  the  lane  tracker.  For  the  exper- 
iment a 2.5  inch  wide  strip  was  laid  down  as  a center  lane  marker  to  be  picked 
up  by  the  position  detector. 

The  servo  control  allows  for  application  of  steering  inputs  to  the  front 
wheels  independently  of  the  driver's  steering  inputs.  This  is  accomplished  by 


260 


hooking  up  an  analogue  tape  recorder  containing  a taped  disturbance  which  is 
played  back  and  passed  by  means  of  an  electro-mechanical  device  through  the 
steering  linkage  to  the  front  wheels.  This  provides  a means  of  measuring  the 
closed  loop  dynamic  behavior  of  the  driver  by  insertion  of  a known  input  or 
disturbance  function  into  the  loop.  The  disturbance  function  used  in  the 
experiment  was  a sum  of  nine  sinusoids  - .377,  .503,  .754,  1.257,  1.634,  2.765, 
4.271,  5.781  and  10.801  rad. /sec.  Each  of  these  input  frequencies  has  an  inte- 
gral number  of  cycles  in  a 50  second  run  length.  The  advantage  of  using  a 
sum  of  sines  input  is  that  while  the  remnant  is  spread  out  over  many  frequencies, 
the  input  is  concentrated  at  discrete  frequencies.  Thus,  at  these  discete  fre-- 
quencies,  where  the  driver  car-driver  transfer  function  is  measured,  the  remnant 
is  swamped  by  that  part  of  the  output  signal  which  is  correlated  with  the  input, 
so  that  relatively  clean  estimates  of  the  correlated  output  are  obtained. 

The  variables  recorded  during  the  subject  runs  were;  steering  wheel  angle, 
front  tire  angle,  heading  angle,  lateral  acceleration,  lateral  position, 
forward  velocity  and  the  disturbance  signal  input. 


Procedure 

Each  of  the  twelve  subjects  came  to  the  test  site  twice  a week  for  five 
weeks.  On  the  first  test  day  it  was  determined  from  the  first  two  subjects  that 
the  novices  could  manage  speed  of  40  k.p.h.  This  determined  the  speed  which 
was  used  for  all  the  test  runs.  Runs  were  made  up  and  down  two  marked  lanes  on 
a half  mile  stretch  of  an  unused  runway.  In  total  200  seconds  of  data  were 
collected  for  each  subject  on  each  day. 


RESULTS 


Changes  in  the  Car-Driver  Transfer  Function  with  Learning 

Table  1 summarizes  the  one  factor,  repeated  measures,  analyses  of  variance 
which  were  carried  out  for  the  amplitude  and  phase  angle  values  in  the  car-driver 
transfer  function,  using  twelve  subjects  and  nine  (treatment)  days.  Analysis 
of  the  power  spectrum  of  steering  wheel  angle  showed  that  the  driver's  input  at 
frequencies  above  2.765  rad. /sec.  was  negligible  (<  1%  of  total  input).  Also, 
at  these  frequencies  the  signal  to  noise  ratio  is  high  and  therefore  the  esti- 
mates are  less  reliable.  Consequently  changes  4t  the  first  six  frequency  points 
(in  the  disturbance  signal  car-driver  transfer  function)  are  of  greatest  int- 
erest. 

Table  1 and  Figure  5 show  that  a significant  increase  in  amplitude 
of  the  car-driver  transfer  function  occurred  over  the  test  period  at  the  first 
four  freqeuncy  points.  However,  the  amplitude  at  the  first  frequency  point 
showed  the  most  dramatic  change.  While  the  means  of  the  first  two  days  were 
approximately  equal,  the  mean  increased  by  40%  on  the  third  day  and  fluctuated 
about  this  value  for  the  last  six  days.  As  this  large  increase  did  not  occur 
at  frequency  points  adjoining  .377  rad. /sec.,  a change  in  slope  of  the  amplitude 
plot  of  the  car-driver  tansfer  function  is  indicated.  When  individual  subject 
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TABLE  1 


Suinnary  Anova  Results:  Amplitude  and 
Phase  of  the  Car  Driver  Transfer  Function 
Nine  (treatment)  Days:  12  Subjects 


Amplitude 


Frequency 

C 

Differences  Between 

rad. /sec. 

^8,88 

(.05  Level) 

.377 

2.242^ 

Day  1 < 3-9 

.503 

3.1 5811 . Day  1 < 5,6,9:  Day 

.754 

4.72511 

Day  1 < 3-9 i Day  "2 

1.257 

2.651 

Day  1 < 3-9 

1.634 

0.845 

2.765 

1.607 

Phase 

Days  c Differences  Between  Days 
^8,88  (-05  level) 

1.622 
Z <9  1.550 
< 4,9  0.930. .. 

4.216TT.  Day  2>5;  Day  8>5i  Day  9>5-7 
BM6.ll  Day  1-6  < 8,9 
21.234  Day  l,2<4-9;  Day  3-6<7-9 


level  of  significance:  .05,  ++  .01,  .001 


plots  were  examined  it  was  found  that,  for  half  of  the  subjects,  the  amplitude 
of  the  .377  rad. /sec.  point  showed  a sharper  increase  over  the  first  three  days 
than  did  the  amplitudes  at  other  frequencies,  while,  for  the  other  half,  the 
whole  amplitude  slope  increased.  As  will  be  shown  in  the  section  on  modelling, 
an  increase  in  the  amplitude  slope,  particularly  at  low  frequencies,  is  a result 
of  the  way  subjects  used  the  lateral  position  cue. 


When  the  phase  angle  (of  the  car-driver  transfer  function)  drops  bblow 
-180°,  the  car-driver  system  becomes  unstable  so  that  an  input  generates  an 
exponentially  increasing  output.  Therefore,  large  phase  angles  (>  -180°)  are 
to  be  desired  around  crossover.  (Phase  angles  at  frequencies  further  from 
crossover  have  little  effect  on  system  stability.)  Figure  6 shows  that  at  the 
frequencies  surrounding  the  crossover  the  phase  angle  increases  gradually, 
though  a little  erratically,  between  days  one  and  nine,  indicating  that  the 
subjects  improved  their  stability  of  control. 


The  changes  in  amplitude  and  phase  angle  of  the  car-driver  transfer  func 
tion  over  the  test  period  were  reflected  in  improved  tracking  performance* 
with  the  largest  improvements  occurring  during  the  first  three  days. 


For  all  the  variables  studied,  the  changes  that  took  place  over  the  last 
six  days  were  much  less  dramatic,  and  much  more  erratic,  than  those  that 
occurred  over  the  first  three  days.  If  measures  on  day  3 are  compared  with 
those  for  days  8 and  9,  no  changes  are  significant,  but  the  following  trends 
were  noted:  an  increase  in  the  amplitude  of  the  car-driver  transfer  function 
at  .503,  .754,  and  1.275  rad. /sec.,  an  increase  in  phase  margin,  and  reduced 
heading  angle  deviation. 


Modelling  the  Driver-Alone  Describing  Function 

In  the  first  two  structures  postulated,  the  driver  adapts  to  each  set 
of  controlled  mechanics  in  such  a manner  that  the  overall  car-driver  transfer 
function  has  the  same  form  (see  Fig.  4).  However,  as  was  noted  previously, 
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Fig.  5.  Change  In  amplitude  (12  sub> 
Jects) 


Fig.  6.  Phase  angle  changes  around 
crossover  (12  subjects) 

experimental  data  shows  that  a switch 
from  proportional  control  (I.e.,  control 
of  lateral  position)  to  rate  control 
(I.e.,  control  of  heading  angle)  results 
In  a large  Improvement  In  crossover 
frequency.  Although  there  was  mean 
Increase  In  crossover  frequency  In  this 
study,  from  1.696  to  1.929  rad. /sec,, 
the  Increase  was  small,  occurred  grad- 
ually, andwas  statistically  Insignifi- 
cant. Only  two  of  the  twelve  subjects 
showed  large  changes  In  crossover  fre- 
quency. Further  examination  of  the  data 
suggested  that  reasons  other  than  a 
change  In  control  structure  were  respon- 
sible for  the  Increase. 


Another  factor  which  aids  In  deciding  upon  the  control  structure  In  use 
Is  the  percent  of  high  frequency  area  (%HFA)  In  the  power  spectrum  of  the 
steering  wheel  angle.  A car's  dynamics  are  such  that  at  the  higher  frequencies 
It  shows  a greater  response  In  heading  angle  than  It  does  In  lateral  position. 
Therefore,  a driver  who  controls  lateral  position  most  use  lower  frequency 
Inputs  to  get  a reasonable  response  from  the  car.  Consequently,  one  would 
expect  that  %HFA  would  be  lower  for  a driver  controlling  lateral  position  than 
It  would  be  for  a driver  controlling  heading  angle.  The  data  showed  that  the 
%HFA  was  higher  rather  than  lower,  though  not  significantly  so.  In  the  first 
days  of  the  experiment  than  In  the  last.  This  Is  another  Indication  that 
the  subjects  were  probably  not  using  the  first  postulated  structure  where  lat- 
eral position  was  the  primary  cue  for  control. 

Though  this  assumption  will  be  used  In  determining  how  the  driver  transfer 
functions  will  be  modelled.  It  must  be  stressed  that  the  structure  of  a system 
with  only  one  Input,  with  which  to  Identify  two  operator  transfer  functions, 
can  only  be  Inferred;  It  cannot  be  known  with  certainty. 

If  the  first  structure  can  be  eliminated  as  a mode  of  control,  the  mod- 
elling of  the  driver-alone  transfer  function  Is  simplified. 
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Let  us  consider  the  third  control  structure.  As  was  discussed  previously, 
the  form  used  for  Y , the  driver's  operation  on  functions  of  lateral  position, 

was  to  be  a simple  gain  K^.  If  the  data  are  fitted  to  this  third  structure, 

but  have.  In  fact,  been  generated  by  the  subject's  using  the  second  structure, 
the  term  will  be  zero.  Consequently,  equation  (5)  will  reduce  to  an  equa- 
tion which  describes  the  second  control  structure.  Consequently  the  value  of 
K will  Indicate  which  structure  was  probably  In  use. 


The  effective  driver-alone  transfer  function  for  the  third  structure  was 
derived  by  removing  , the  car's  dynamics  In  heading,  and  modelled  using: 


-wr  (»  1 


(S) 


T 


t 


6*  (jw) 


w 


Table  2 shows  the  values  derived  for  K^,  x,  T^,  and  for  selected 
test  days,  averaged  over  twelve  novice  drivers  (see  also  Figure  7). 


TABLE  2 

Parameters  for  the  Averaged 
Effective  Driver  Transfer  Function 


Day 

deg. /deg. 

K'  rad. /sec. 

T sec. 

1 

0.590 

^ 0.20 

.42 

2 

0.655 

0.20 

.42 

3 

0.595 

0.44 

.36 

6 

0.615 

0.71 

.37 

9 

0.630 

0.82 

.25 

(since  T^  : T^  (» 

9.4  rad. /sec. 

for  the  test  car),  T^ 

= T^  was  assumed) 

r 

K*  a K Uo  where  Uo  Is  the  forward  velocity 

Discussion  of  Modelling  Results 


Data,  from  experienced  drivers,  that  (In  reference  8)  was  fitted 
to  the  third  control  structure  show  the  amplitude  fit  to  be  good  across  all 
frequencies  measured  and  the  phase  fit  to  be  best  nearest  the  crossover  fre- 
quency. This  same  type  of  model  fit  was  obtained  with  the  experimental  data. 
Goodness  of  fit  parameters  were  calculated  using  the  distance  from  the  modelled 
to  the  actual  data  point,  relative  to  the  standard  deviation  at  that  point. 

For  the  experimental  car,  Lite  response  lag  which  Is  offset  by  the  driver's 
use  of  heading  rate  (vs.  heading  angle)  begins  to  have  effect  at  9.4  rad. /sec. 
(the  break  frequency).  Though  1/T^  Is  expected  to  be  approximately  equal  to 

9.4  rad. /sec.,  and  because  this  value  1$  far  enough  outside  the  measurement 
frequency  range  to  have  little  effect  on  the  model  anyway,  9.4  rad. /sec.  was 
used  for  the  value  of  1/T^  for  all  days.  It  Is  evident  from  the  fit  parameters 
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in  Table  2 that  the  largest  changes  oecured  In  the  value  of  K^.  The  smaller 
changes  In  the  parameter  Indicate  that  heading  angle  was  controlled  In  much 
the  same  way  on  the  first  day  as  on  the  last.  In  contrast,  the  value  of  Ky 

doubled  between  days  two  and  three,  moving  within  the  measurement  frequency 
range  (I.e.»  > .377  rad. /sec.),  and  doubled  again  between  days  three  and  nine. 
This  change  reflects  the  large  Increase  In  the  amplitude  of  the  car  driver 
transfer  function  at  .377  rad. /sec.  between  days  two  and  three.  The  Increases 
In  the  value  of  point  to  the  Increased  control  of  lateral  position  as  de- 
fined In  the  third  structure.  The  phase  fits  were  so  poor  that  very  little 
faith  can  be  placed  In  the  time  delay  values.  However,  they  do  conform  to  the 
findings  of  other  reasearchers  that  the  time  delay  decreases  with  learning 
(Reference  I).  A large  Improvement  In  the  model  fit  to  the  phase 
data  occurred  over  the  learning  period  as  the  low  frequency  phase  droop  became 
less  noticeable  (as  Illustrated  In  Fig.  7). 


Fig.  7.  Effective  driver  transfer 
function,  averaged  over  12 


CONCLUSIONS 

In  summary,  though  the  fit  para- 
meters do  not  Indicate  a sharp  division 
between  days  one  and  two  and  day  three, 
enough  of  a change  In  Is  Indicated 

to  suggest  that  on  day  three  and  there- 
after the  drivers'  control  structure 
bore  more  resemblance  to  structure 
three,  where  an  outer  loop  controlled 
lateral  position,  than  to  structure 
two,  while  on  days  one  and  two,  the 
reverse  was  true. 

Other  experimenters,  using  lab- 
oratory tracking  tasks  (Reference  9) 
have  not  found  changes  in  strategy 
with  the  learning  of  tracking  control 
but  did  note  Improvements  In  gain  and. 


subjects,  days  1 and  9 crossover  frequency.  Using  a more 

complex  tracking  task,  steering  a car, 
such  a change  in  strategy  was  found  to  occur,  as  well  as  the  previously  noted 
change  in  gain.  Phase  margin  rather  than  crossover  freouency  was  found  to 
Improve  with  learning  indicating  that  the  subjects  opted  for  an  improvement 
in  stability  of  control  over  Improved  system  response. 
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SUMMARY 


This  paper  reviews  the  use  of  motivational  techniques  in  human  perfor- 
mance research  and  presents  an  example  study  employing  a reward-penalty 
structure  to  simulate  the  motivations  inherent  in  a real-world 
situation.  The  influence  of  motivation  on  human  perfonnance  has  been  an 
issue  since  the  beginning  of  behavioral  science.  Most  often,  motivation  is 
controlled  through  procedures  designed  to  minimize  its  influence  as  an  uncon- 
trolled variable.  Driver  behavior  in  a decision-making  driving  scenario  was 
studied . 

The  task  involved  control  of  an  instrumented  car  on  a cooperative  test 
course.  Subjects  were  penalized  monetarily  for  tickets  and  accidents  and  re- 
warded for  saving  driving  time.  Two  groups  were  assigned  different  ticket 
penalties.  The  group  with  the  highest  penalties  tended  to  drive  more  conser- 
vatively. However,  the  average  total  payoff  to  each  group  was  the  same,  as 
the  conservative  drivers  traded  off  slower  driving  times  with  lower  ticket 
penalties. 


INTRODUCTION 


Reward-penalty  structures  have  existed  since  the  beginning  of  experimen- 
tation, and  the  effects  of  such  structures  have  evolved  into  a sfparate  area 
of  research.  As  early  as  1922,  A.  M.  Johanson  observed  the  effects  of  re- 
wards and  penalties  on  reaction  times.  These  classic  results  (cited  in  Ref. 
1)  are  shown  in  Fig.  1.  Researchers  have  examined  the  motivational  aspects 
(Refs.  2-6),  looked  at  rewards*  distracting  effects  (Refs.  7*-10),  and 
looked  at  the  positive  effects  of  rewards  (Refs  11  and  12).  What  does  this 
experimentation  mean,  and  how  can  the  researcher  of  today  utilize  the  efforts 
of  others? 

Subject  motivation  is  a primary  concern  in  any  experiment.  "We  want  the 
subject  motivated  to  come  back  for  12  experimental  sessions;"  or  "we  want  the 
subject  motivated  to  respond  as  quickly  as  possible;"  or  "we  want  the  subject 
motivated  to  respond  in  a manner  consistent  with  his  or  her  normal 
behavior."  Rewards  and  penalties  play  an  important  part  in  this  motivation. 
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Figure  1.  Change  in  the  Distribution  of  Reaction 
Time  Under  the  Influence  of  Incentives.  Auditory 
stimulus.  In  the  "incentive  series"  0 was  informed 
of  his  last  RT;  in  the  "punishment  series"  he  re- 
ceived a shock  in  the  finger  when  the  reaction  was 
at  all  slow.  Each  curve  shows  the  distribution  of 
3600  single  reactions  obtained  from  three  Os  whose 
times  were  nearly  the  same.  (Adapted  from  Ref.  1) 


To  assess  reward-penalty  structures  with  regard  to  their  consequences, 
and  to  develop  a structure  for  a given  experiment,  requires  a basic  knowledge 
of  the  literature,  terminology,  and  present  methodologies.  This  paper  is  a 
review  of  the  present  body  of  knowledge  with  an  emphasis  on  reward-penalty 
design  consequ#‘nces  for  human  perfonnance  research. 


PREVIOUS  RESEARCH 


Definitions 

The  distinction  between  intrinsic  and  extrinsic  motivation  should  be  an 
important  consideration  when  designing  a reward-penalty  structure.  If  a per- 
son chooses  to  work  a series  of  complex  mathematical  problems  because  of  per- 
sonal enjoyment,  then  the  "perceived  locus  of  causality"  (Ref.  6)  is  inter- 
nal, and  the  task  is  intrinsically  motivating.  If,  however,  the  person 
chooses  to  work  the  problems  to  gain  an  external  reward,  and  the  "perceived 
locus  of  causality"  is  external,  then  the  task  is  extrlnsically  motivating 
(Refs.  3,  M,  6,  13-15). 

Deci  (Refs.  2 and  3)i  Decl,  Benware,  and  Landy  (Ref.  4),  and  Edwards 
(Ref.  16),  all  point  out  that  reward-penalty  struccures  can  be  designed  to 
be  either  extrlnsically  motivating  or  neutral.  If  the  experimenter  chooses 
to  have  the  structure  of  neutral  Influence  on  the  subject,  and  at  the  same 
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time  achieve  high  subject  motivation,  it  becomes  necessary  to  use  a task  that 
has  been,  or  can  be,  shovm  to  be  intrinsically  interesting  to  the  subject  po- 
pulation. If  the  choice  is  to  have  a structure  that  makes  the  reward  or  pen- 
alty contingent  on  performance,  or  in  some  other  way  extrinsically  motivat- 
ing, then  the  choice  of  experimental  task  is  of  secondary  consideration.  It 
has  been  shown  by  Lepper  and  others  (Refs.  3,  4,  13,  and  14)  that  subjects 
performing  tasks  of  high  intrinsic  motivation,  receiving  extrinsic  rewards, 
perceive  the  locus  of  causality  to  be  external,  and  show  low  intrinsic  moti- 
vation. 


Purpose  of  Rewards  and  Penalties 

As  pointed  out  by  Edwards  (Ref.  16),  rewards  and  penalties  can  serve 
three  purposes:  1)  motivators,  2)  information  givers,  and  3)  instructions. 

If  the  subject  is  rewarded  only  for  participation  in  an  experiment,  then  the 
reward  serves  as  a motivator;  the  subject  will  perceive  the  locus  of  causali- 
ty as  internal,  and  the  experimental  task*  will  be  Intrinsically 
motivating.  If  the  reward-penalty  structure  is  changed,  and  task  performance 
is  rewarded  the  reward  or  penalty  will  serve  as  information,  in  addition  to 
any  motivating  influence  it  has.  If  the  experimental  task  is  solving  complex 
mathematical  problems,  and  the  subject  is  paid  hourly  for  experimental  parti- 
cipation, then  task  performance  is  unrelated  to  the  reward,  and  the  reward's 
purpose  is  that  of  a motivator.  If  the  reward  is  increased  as  a function  of 
problem  completion  time,  or  number  of  problems  solved,  the  reward  takes  on 
the  additional  quality  of  an  information  giver.  In  this  case  it  is  important 
to  note  that  correct  response  is  not  required. 

If  correct  response  is  required  for  a reward  increase,  or  incorrect  res- 
ponse is  punished,  the  reward  also  serves  as  an  Instruction.  In  this  case 
the  reward  not  only  provides  motivation  and  information,  it  now  tells  the 
subject  the  relative  desirability  of  a specific  response.  Withholdihg  the 
reward  until  the  completion  of  the  experiment  does,  not  alter  its  motivational 
or  instructional  qualities.  Because  the  reward  is  performance  related,  with- 
holding payment  (or  Information  about  the  reward  "earned”)  only  eliminates 
the  informational  feedback  quality. 


Form  of  Rewards  and  Penalties 

Rewards  and  penalties  can  take  many  forms,  and  the  type  of  reward  or  pen- 
alty chosen  by  the  experimenter  should  be  an  important  part  of  the 
reward-penalty  design.  The  overall  effe*  t of  the  reward  or  penalty  needs  to 
be  assessed  prior  to  its  introduction  in  the  experiment.  For  example,  Deci 
(Ref.  2)  found  that  monetary  rewards  caused  a decrease  in  intrinsic  motiva- 
tion, while  rewards  by  use  of  verbal  reinforcement  caused  an  increase. 
McCloskey  (Ref.  17),  in  her  work  with  staff  turnover  rates,  found  that  psy- 
chological rewards  such  as  recognition,  help  from  peers,  and  educational  op- 
portunities were  more  important  in  keeping  an  employee  than  salary  or  Job 
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benefits;  and  that  money  alone  would  not  keep  an  employee.  Viesti  (Ref.  18) 
found  that  on  an  insightful  learning  task  pay  made  no  difference  in  perfor> 
mance. 

One  of  the  most  commonly  used  rewards  is  money.  Many  researchers  have 
examined  the  advantages  and  pitfalls  of  this  reward  form,  and  their  findings 
can  be  of  great  assistance  in  developing  a reward-penalty  structure. 

Money  seems  to  provide  the  best  balance  between  response  and  error  rate. 
Daniels,  et  al.(Ref.  11),  found  that  response  speed  remained  constant,  but  a 
drastic  reduction  in  error  rate  was  observed  when  real  instead  of  imaginary 
money  was  used.  Slovlc,  Lichtenstein,  and  Edwards  (Ref.  19)  found  that  sub- 
jects employed  simpler  decision  strategies  in  an  imaginary  incentive  design 
than  with  real  payoffs.  Also  Slovic  (Ref.  20)  found  that  when  subjects  made 
hypothetical  choices,  they  maximized  gain  and  discounted  losses;  however, 
when  their  choices  had  real  consequences,  the  subjects  were  considerably  more 
cautious. 

The  researcher  should  be  cautioned  by  the  work  of  Greenberg  (Ref.  21) 
and  Leventhal  and  Whiteside  (Ref.  22),  however.  They  have  shown  that  mone- 
tary reward  can  be  used  to  motivate  performance,  but  that  overreward  is  fre- 
quently employed.  In  some  cases  the  overrewarding  tendency  was  so  strong 
that  higher  rewards  were  given  to  lower  performing  workers.  Furthermore, 
Spence  (Refs.  8 and  9),  Miller  and  Estes  (Ref.  10),  and  McGraw  and  McCull- 
ers  (Ref.  7)  point  out  that  increased  rewards  may  draw  attention  from  the 
experimental  task. 


EXPERIMENTAL  STUDY 


The  above  research  findings  clearly  show  the  need  for  appropriate 
reward-penalty  designs,  both  in  form  and  magnitude.  The  following  examples, 
part  of  a study  on  alcohol-driver  interaction,  show  how  this  information  can 
be  used  to  create  a reward-penalty  structure. 

In  a study  concerning  the  effects  of  alcohol  on  drivers'  decision  making 
behavior,  two  separate  experiments  were  conducted.  The  first  was  run  in  our 
fixed-base  driving  simulator  (Ref.  23)  and  the  second  in  an  instrumented 
vehicle  designed  for  the  National  Highway  Traffic  Safety  Administration  (Ref. 
24). 


In  both  experiments  the  subject  was  required  to  complete  a driving  sce- 
nario in  both  sober  and  intoxicated  states.  The  following  is  a brief  discus- 
sion of  the  requirements,  design,  and  effects  of  variations  in  a motivational 
reward-penalty  structure. 
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Reward-Penalty  Structure 


Driving  in  the  real  world  is  motivated  by  a variety  of  counteracting  in- 
centives. Drivers  wish  to  minimize  trip  time  but  avoid  tickets  and  acci- 
dents. Driving  behavior  is  influenced  by  these  motivations,  particularly  in 
risk-taking/decision-making  tasks.  In  order  to  encourage  real-world- like  be- 
havior we  must  attempt  to  simulate  the  real-world  incentives.  The  problem 
with  simulating  typical  driving  incentives  is  that  they  include  some  diffi- 
cult- to-quantify  variables,  such  as  the  subjective  value  of  time  gained  by 
driving  faster  and  the  subjective  fear  of  low  probability  events  such  as  auto 
crashes.  Negative  reinforcement  with  electric  shock  is  a classical  experi- 
mental technique  and  might  serve  to  simulate  the  pain  of  an  accident,  but 
this  technique  is  difficult  to  quantify  and  recent  subject  welfare  guidelines 
make  it  unattractive.  In  a recent  aircraft  landing  experiment  involving 
pilot  decision  making  (Ref.  25),  the  experimenters  went  so  far  as  to  inform 
their  pilot  subjects  that  they  would  be  eliminated  from  the  experiment  in  the 
event  they  crashed  in  order  to  make  them  as  averse  to  crashes  as  they  would 
be  in  real  life.  However,  this  approach  would  be  logically  awkward  in  this 
study  because  we  would  lose  selected  and  trained  subjects  and,  furthermore, 
the  majority  of  driving  accidents  do  not  involve  fatalities. 

The  traditional  method  of  quantifying  incentives  for  experimental  control 
is  to  relate  them  to  some  well-defined  variable  with  interval  properties  by 
measuring  Indifference  curves  (Refs.  26  and  27).  The  most  well-defined, 
widely  studied,  and  widely  used  norm  is  money,  primarily  because  of  its  in- 
terval properties  and  interchangeability.  Money  has  some  limitations;  for 
example,  the  decision-making  behavior  has  been  shown  to  be  confounded  by  the 
subject's  financial  status.  However,  this  can  be  experimentally  controlled 
by  controlling  the  knowledge  of  results  (Ref.  28).  In  general,  the  addi- 
tional experimental  effort  required  to  scale  other  disincentives  (e.g., 
shock,  loud  noises,  etc.)  has  led  to  widespread  use  of  money  for  rewards  and 
punishments  in  decision-making  experiments. 

In  both  experiments  the  reward-penalty  structures  had  multiple  require- 
ments. A major  concern  was  that  the  subject  complete  the  driving  scenario  in 
a normal  manner,  with  a reasonable  motivation  for  timely  progress  and  a de- 
sire to  avoid  tickets  and  accidents;  that  is,  we  wanted  the  subject  to  drive 
as  if  the  driving  situation  were  being  experienced  in  the  real  world.  A sec- 
ond requirement  was  that  the  subjects  return  for  participation  in  six 
full-day  experimental  sessions.  Finally,  we  chose  to  alter  the  penalty 
structure  in  the  experiment  to  determine  the  behavioral  effects  of  increased 
ticket  penalty  on  the  driver. 

With  the  exception  of  ticket  penalties,  the  reward-penalty  structure  for 
both  experiments  was  the  same.  In  order  to  provide  a basic  motivation  to  re- 
main in  the  study,  the  subjects  were  paid  an  hourly  wage.  This  parent  was 
received  by  the  subject  irrespective  of  performance.  To  facilitate  comple- 
tion of  the  driving  scenario,  and  to  encourage  normal  driving  behavior,  we 
used  an  additional  reward-penalty  structure  scaled  to  real  world  occurrences. 
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Rewards  consisted  of  $10.00  for  completing  the  driving  scenario,  and 
$2.00  for  every  minute  of  total  elapsed  driving  time  under  20  minutes. 
Assuming  a real  world  situation  of  leaving  a bar  intoxicated,,  this  rewarded 
the  subject  for  making  it  home  and  for  driving  with  the  flow  of  traffic,  thus 
avoiding  detection. 

In  both  experiments,  crashes  (l.e.,  hitting  an  obstacle  or  adjacent  car, 
or  running  off  the  roadway)  were  penalized  $2.00. 

Tickets  were  given  for  running  a red  light  or  for  speeding.  Again  to 
simulate  a real  world  driving  experience,  the  traffic  police  were  present 
only  30%  of  the  time.  In  experiment  1 (the  simulation),  tickets  were  either 
$1.00  or  $2.00,  depending  on  the  group  to  which  the  subject  was  assigned.  In 
experiment  2 (full-scale),  tickets  were  either  $1.00  or  $4.00. 

Subjects  received  immediate  feedback  if  they  crashed  (buzzer),  or  re- 
ceived a ticket  (siren  and  red  lights),  but  total  rewards  and  penalties  were 
withheld  until  the  completion  ol  the  experimental  day.  Again  this  simulates 
the  real  world,  because  the  cost  of  a ticket  or  crash  is  rarely  known  when 
the  incident  occurs. 


RESULTS  AND  DISCUSSION 

To  determine  the  suitability  of  our  reward-penalty  structure  to  the  ex- 
periment, two  criteria  can  be  used.  First,  did  all  the  subjects  complete  the 
experiments?  In  both  experiment  1 and  experiment  2 the  answer  was  yes,  indi- 
cating that  we  were  able  to  keep  the  subjects  sufficiently  motivated  to  re- 
turn. Second,  to  correlate  our  results  with  real  world  driving  statistics, 
we  compared  our  simulator  and  field  test  results  with  epidemiological  data  of 
over  7000  alcohol  related  traffic  accidents.  As  evidenced  in  Fig.  2,  the 
simulator  results  and  the  field  results  compare  favorably  with  the  actual  ac- 
cident data,  thus  indicating  drivers  motivated  to  take  comparable  risks. 

Finally,  in  our  investigation  of  the  behavioral  effects  of  a change  in 
penalty  structure,  we  found  in  experiment  1 no  significant  difference  between 
the  $1.00  ticket  group  and  the  $2.00  ticket  group.  Experiment  2,  however, 
did  show  a significant  difference  between  the  $1.00  ticket  group  and  the 
$4.00  ticket  group. 

I 

In  Fig.  3 we  see  that  the  high  penalty  group  in  the  field  study  had  on 
the  average  of  one- third  less  tickets,  with  speeding  tickets  showing  a 
greater  sensitivity  than  signal  light  tickets.  These  results  are  statisti- 
cally significant  as  shown  in  Table  1.  Driving  time  differences  between  the 
two  penalty  groups  were  marginally  significant  (Table  1)  and  consistent  with 
the  ticket  results,  e.g,  larger  time  and  fewer  tickets.  Payoff  was  not  sig- 
nificantly different  between  the  penalty  groups,  however  (Table  1),  which  in- 
dicates a compensatory  tradeoff  between  driving  time  and  ticket  rate. 
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TABLE  1.  ANALySIS  OF  VARIANCE  SUMMARY  FOR  OVERALL  SCENARIO 
PERFORMANCE  IN  THE  FIELD  VALIDATION  STUDY 


SOURCE 

ERROR 

TEBI^ 

DECaiEES 

OF 

FREEDOM 

F RATIOS 

PAYOFF 

DRIVING 

TIME 

ACCI- 

DENTS 

SIGNAL 

TICKETS 

SPBEDINC- 

TICKETS 

ROUTE 

ERRORS 

Day 

DS(P) 

1 

19.55*** 

2.92 

12.71** 

2.09 

15.96** 

1.50 

Penalty 

S(P) 

1 

2.37 

4.20t 

1.92 

10.80** 

5.47* 

1.55 

Trial 

TS(P) 

2 

10.44** 

2.27 

13.56** 

4.72* 

3.71* 

1.41 

DP 

DS(P) 

1 

0.35 

0.42 

1.08 

0.52 

2.67 

1.50 

DT 

BTS(P) 

2 

15.71*** 

1.0 

11.55** 

2,16 

4.10* 

1.26 

PC 

TS(P) 

2 

0.59 

2.02 

0.40 

1.15 

0.55 

1.55 

DPT 

DTS(P) 

2 

1.40 

1.65 

1.27 

2.08 

0.90 

1.49 

Level  of  Significance:  tp  < 0.10;  *p  < 0.05;  **P  < 0.01;  ***p  < 0.001. 

aError  term  degrees  of  freedom:  S(P)  - 12,  DS(P)  - 12,  TS(P)  - 2l^,  DTS(P)  - 24. 


I 301 
> 

§ 

f 251 


20 


O — O Grand  Rapids  Data , 5985  Total  Crashes 
O- — O Grand  Rapids, 300  Fatal  or  Serious  Crashes 
^ Evanston  Dato,  270  Crash  Injuries 
A--- A Toronto  Data, 423  Total  Crashes 
□ — □ Vermont  Data , 106  Fatal  Crashes  # 
o — a Manhattan  Data,  34  Fatal  Crashes  f 


--a 


STI  Simulation  Study, 
47  Total  Crashes 

STI  Field  Study 
74  Total  Crashes 


.05  .10  .15  .20 

Blood  Alcohol  Concentration  ( BAC ) , % W/ V 

Figure  2.  Relative  Probability  of  Crash  Involvement  as  a Function 
of  BAC  Where  1.0  s Relative  Probability  at 
Zero  Alcohol  (Adapted  from  Ref.  29) 
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Figure  3.  Penalty  Effect  on  Ticket  Rate  and  Total  Time 
to  Complete  the  Driving  Scenario 
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Some  insight  into  the  ticket  reduction  with  increased  penalty  can  be  ga« 
ined  from  the  signal  light  risk  acceptance  plot  shown  in  Fig.  4 (Ref.  30). 
Here  we  see  that  the  high  penalty  group  perceived  higher  risks  in  signal 
failures  (i.e.,  running  the  red  light)  and  was  willing  to  go  less  often.  The 
oOTblned  effect  was  much  more  conservative  behavior  for  the  high  penalty 
group,  leading  to  better  driving  performance.  The  P(G)  and  SP(F/G)  differ- 
ences in  Fig.  4 were  statistically  significant,  but  the  SP  difference  was 
not.  No  group  differences  were  observed  for  accident  data  In  the  experiment, 
and  because  of  the  magnitude  of  the  ticket  and  P(G)  group  differences  it  is 
assumed  that  these  are  true  penalty  effects  and  not  Just  between-group 
differences. 


CONCLUDING  REMARKS 


The  following  conclusions  were  drawn  with  respect  to  the  reward-penalty 
structure  in  our  experiments: 


Figure  4.  Mean  Subjective  Probability  of  Failure  to  Make  I'  Through 
the  Light  If  It  Here  Attempted 
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* Driving  is  not  intrinsically  motivating  to  the  majority  of 
the  population,  and  in  experimental  tasks  is  even  less  so. 
Real-world  Motivation  incentives  such  as  accidents,  tickets, 
and  desire  to  safe  time,  are  extrinsic. 

* Rewards  and  penalties  roust  be  tangible.  Imaginary  rewards 
and/or  verbal  reinforcement  are  not  sufficient. 

* Rewards  and  penalties  should  serve  as  general  motivation,  but 
not  direct  feedback  in  the  driving  scenario. 

* Between  runs  in  an  experimental  session,  overall  performance 
payoffs  should  be  withheld  in  order  to  avoid  feedback  or  re- 
inforcement which  might  modify  behavior  on  subsequent  runs. 

* Our  results  show  that  employing  a specifically  designed  mone- 
tary reward-penalty  structure  provides  sufficient  extrinsic 
motivation  to  duplicate  a "real  world"  driving  situation. 

These  results  on  reward/penalty  effects  on  driver  risk  taking  might  be 
extrapolated  to  real-world  driving  behavior.  Perhaps  drivers  would  drive 
more  conservatively  with  increased  and  more  evenly  applied  penalties  for 
traffic  violations. 
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SUMMARY 

The  effects  of  changes  in  understeer,  control  sensitivity,  and  location 
of  the  lateral  aerodynamic  center  of  pressure  (c*p*)  of  a typical  passenger 
car  on  the  driver's  opinion  and  on  the  performance  of  the  driver-vehicle 
system  were  studied  in  the  moving-base  driving  simulator  at  Virginia  Poly- 
technic Institute  and  State  University*  Twelve  subjects  with  no  prior 
experience  on  the  simulator  and  no  special  driving  skills  performed  regula- 
tion tasks  in  the  presence  of  both  random  and  step  wind  gusts* 


INTRODUCTION 

The  performance  of  the  driver-vehicle  system  in  the  presence  of  cross- 
wind  disturbances  is  influenced  by  the  location  of  the  lateral  aerodynamic 
center  of  pressure  (c.p*)  of  the  vehicle* 

The  extent  to  which  changes  in  c.p*  location  are  discernible  and/or 
objectionable  to  ordinary  drivers  has  up  to  this  time  been  unknown*  Most 
of  the  previous  studies  on  wind  gust  disturbance  regulation  tasks  have 
concentrated  on  a single  c.p*  location  with  the  c.p*  most  frequently 
placed  at  the  front  wheels  (references  1-5) * Also,  although  the  influence 
of  changes  in  ddsign  parameters,  such  as  understeer  and  control  sensitivity, 
have  been  studied  previously  (references  3,  4),  the  interaction  of  these 
parameters  with  the  location  of  the  c.p.  in  a closed-loop  task  is  unknown* 

The  present  study  examines  the  influence  of  various  combinations  of 
understeer,  control  sensitivity,  and  c.p.  location  on  the  performance  of 
twelve  ordinary  drivers  in  the  presence  of  wind  gust  disturbances. 

The  Virginia  Polytechnic  Institute  and  State  University  (VPI&SU)  moving- 
base  driving  simulator  was  chosen  for  the  tests  because  of  the  control  it 
offers  over  the  parameters  of  interest  and  because  of  the  success  of  previous 
research  perf ^rmed^with  the  facility  (reference  1).  The  following  sections 
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describe  the  simulation  facility/  the  experimental  design  and  procedure 
employed/  the  performance  measures  utilized,  and  the  results  obtained. 


THE  VPI&SU  DRIVING  SIMULATOR 

This  experimental  facility  provides  the  subject  with  an  on-line,  com- 
puter-generated, television-type  display  of  the  roadway  in  coordination  with 
the  motion  cues  of  yaw  and  roll,  as  well  as  lateral  and  longitudinal  trans- 
lation. In  addition,  four  channels  of  sound  along  with  vibration  are  pro- 
vided for  the  enhancement  of  the  simulation  realism. 

Three  separate  inputs  were  provided  to  the  vehicle  model  used  for  the 
simulation;  namely,  steering  wheel  displacement,  accelerator/brake  displace- 
ment, and  aerodynamic  force  (wind  gust).  The  model  consisted  of  a set  of 
transfer  functions  relating  the  three  inputs  to  the  vehicle  motion  compo- 
nents. 

References  1,  6,  and  7 contain  a detailed  description  of  the  driving 
simulator  and  related  equipment;  figure  1 shows  the  simulator  motion  plat- 
form. 


DEFINITIONS  AND  EXPERIMENTAL  PROCEDURE 


Definitions 


The  three  experimental  variables  are  defined  briefly  as  follows: 

1.  C.p.  location,  x^  : The  distance  between  the  front-wheel  axis 

and  the  point  of  action  of  the  lateral  aerodynamic  force 

(see  figure  2) . 

This  variable  is  expressed  as  a percentage  of  the  vehicle  wheelbase 
(x^  0.0%  corresponds  to  a c.p.  Ipcation  at  the  front  wheels). 

2.  Understeer,  K : The  numerical  difference  between  the  sideslip 

angles  developed  at  the  front  and  rear  wheels  during  a 1-g  lateral 
acceleration. 

Understeer  is  conventionally  measured  in  deg/g.  A more  detailed  descrip- 
tion of  this  concept  is  given  in  reference  8.  Figure  2 shows  the  paths 
that  vehicles  with  understeer  (K  > 0) , neutral  steer  (K  = 0) , and  over- 
steer (K  < 0)  would  follow  under  the  influence  of  ar  external  side  force 
acting  at  the  center  of  gravity. 
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3.  Control  sensitivity,  C.S*  : The  steady^-state  lateral  acceleration 

(in  g’s)  developed  by  a vehicle  following  a steering  wheel  displace- 
ment of  1*75  rad  (100*0  deg)* 


Experimental  Design 


A mixed  be tween-subjects  and  within-subjects  factorial  design  was 
used,  containing  two  levels  of  understeer  (K  = 3*0,  5*0  deg/g) , two 
levels  of  control  sensitivity  (C*S*  = 0.8,  1*2  g/100  deg),  and  three  c*p* 
locations  (x^  = 0%,  19%,  37%  of  wheelbase)  for  a total  of  twelve  vehicle 
configurations.  Six  male  and  six  female  college  students  without  any 
previous  simulator  experience  were  used  as  subjects*  Three  male  and  three 
female  subjects  were  randomly  assigned  to  each  of  the  two  understeer  condi- 
tions (understeer  was  a between-subjects  variable) . The  other  two  variables 
were  f actor ially  complete  and  equally  likely  for  all  subjects*  The  sxibjects 
were  given  a 1.5  min  period  of  practice  following  which  they  were  required 
to  maintain  a constant  speed  of  97  km/h  (60  mph)  while  keeping  their  normal 
lane  position  in  the  presence  of  random  wind  disturbances.  Data  were 
collected  for  a period  of  2*0  min.  Following  the  random  wind  disturbances, 
a series  of  step  gusts  were  presented  for  an  additional  2.0  min  period*  At 
the  end  of  each  run,  the  subjects  rated  the  disturbances  they  encountered, 
taking  into  account  the  vehicle  path  deviations  and  the  amount  of  steering 
activity  needed  to  maintain  course. 


Data  Collection 


The  time  histories  of  the  vehicle  lateral  position  and  yaw  heading 
deviations,  as  well  as  the  driver’s  steering  wheel  inputs  were  recorded 
on  an  F*M.  tape  recorder.  The  objective  measures  of  performance  were  the 
root-mean-square  (rms)  values  of  these  time  histories,  together  with  the 
peak  lane  overshoots  during  the  step  gusts. 


RESULTS 


Subjective  Ratings 


Figure  3 shows  that  the  subjective  ratings  improve  as  the  c.p.  moves 
rearward*  The  other  two  variables  had  no  significant  effect  on  the  ratings. 


Random  Disturbance  Performance 


Significant  differences  in  lane-keeping  performance  occurred  as  a 
result  of  changes  in  C.S.  and  . There  is  a strong  indication  of  an 
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effect  on  lateral  position  deviation  due  to  an  interaction  between  under- 
steer and  c«p*  location  and  a significant  effect  from  this  interaction  on 
yaw  deviations. 

Figure  4 shows  that  increases  in  both  C.S.  and  result  in  decreases 
in  lateral  position  deviations.  The  nature  of  the  interaction  between  K 
and  that  approached  significance  in  shown  in  figure  5.  The  higher 

value  of  understeer  has  a beneficial  effect  on  lateral  position  deviations 
only  when  the  c.p.  is  located  close  to  the  front  wheels.  Figures  6 and  7 
show  similar  effects  for  yaw  angle  deviations. 

Steering  wheel  deviations  were  significantly  affected  by  all  three 
vehicle  parameters.  Furthermore,  there  were  significant  effects  due  to 
interactions  between  c.p.  location  and  under steer  and  between  c.p.  location 
and  control  sensitivity. 

Figure  8 shows  that  increases  in  K,  C.S.,  and  x^  all  have  a similar 
effect;  namely,  to  decrease  steering  deviations.  Figure  9 reveals  that 
increases  in  both  K and  C.S.  result  in  greater  decreases  in  steering  devia- 
tions the  closer  the  center  of  pressure  is  to  the  front  wheels. 


Step  Disturbance  Performance 


The  peak  lane  position  overshoot  was  measured  from  the  actual  vehicle 
position  prior  to  the  gust  onset  and  not  from  the  center  of  the  lane. 

Figure  10  shows  that  increases  in  x^  and  in  C.S.  reduce  peak  lane 
position  overshoot.  The  effects  of  understeer  were  accentuated  as  the 
c.p.  location  moved  forwaurd,  with  the  lower  level  of  understeer  resulting 
in  the  largest  lane  position  overshoot. 


DISCUSSION 


The  subjective  and  objective  measures  used  in  the  present  study 
indicate  that  c.p.  location  is  an  extremely  important  parameter  for  wind 
gust  regulation  performance.  Scores  on  the  0-10  Rating  Scale,  maximinn 
lane  deviations  following  a step  wind  gust,  and  steering  wheel  deviations 
during  presentation  of  the  random  wind  gust  were  all  highly  significantly 
affected  by  changes  in  c.p.  location*  Actual  lane  position  deviations 
during  the  random  wind  gust  task  were  only  slightly  less  sensitive  to 
changes  in  c.p.  location  than  these  other  measures. 

In  spite  of  its  great  importance,  however,  c.p.  location  is  difficult 
to  control  in  practice  (reference  9) . For  this  reason,  other  means  for 
improving  disturbance  responses  of  the  closed-loop  driver-vehicle  system 
were  explored;  namely,  through  changes  in  understeer  and  control  sensitivity. 
Both  parameters  were  found  to  have  a significant  effect  on  wind  gust  regula- 


tion  performance#  although  sxibjective  opinion  data  failed  to  detect  t^his 
effect*  Increased  levels  of  understeer  (K  = 5.0  deg/g  vs. 3.0  deg/g)  and 
control  sensitivity  (C.S.  = 1.2  g/100  deg  vs  0.8  g/100  deg)  both  had  a 
beneficial  effect  on  measures  of  path  control  and  driver  steering  wheel 
deviations.  These  beneficial  effects  were  accentuated  where  they  were 
needed  the  most;  namely#  at  forward  c.p.  locations. 


CONCLUSIONS 


The  following  conclusions  were  reached; 

•Driver  opinion  ratings  were  significantly  influenced  by  c.p. 
location  only#  with  rearward  locations  rated  the  most  favorable. 

•Lane«*keeping  accuracy  improved  as  the  c.p*  moved  rearward 
and  as  control  sensitivity  increased* 

•For  the  foward  c.p.  locations#  lane-keeping  perfomance 
improved  with  increased  under steer. 

•Steering  wheel  activity  required  for  control  was  reduced  by 
increased  understeer  and  control  sensit.ivity  and  by  rearward 
movement  of  the  c.p. # with  the  effects  of  understeer  and 
control  sensitivity  accentuated  at  forward  c.p.  locations. 

Overall#  the  location  of  the  aerodynamic  center  of  pressure  was  the 
predominant  vehicle  characteristic  with  an  influence  that  could  only 
partially  be  offset  by  changes  in  understeer  and  control  sensitivity. 
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FIG.  1 DRIVING  SIMULATOR  MOTION  PLATFORM 
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FIG.  2 DEFINITIONS 
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FIG.  3 DEPENDENCE  OF  SUBJECTIVE  RATINGS  OF  VEHICLE 
CONFIGURATIONS  ON  C.P.  LOCATION 
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FIG.  4 EFFECTS  OF  CONTROL  SENSITIVITY  AND  C.P.  LOCATION 
ON  LATERAL  POSITION  DEVIATION  (RANDOM  WIND  GUST! 
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FIG.  5 COMBINED  EFFECTS  OF  UNDERSTEER  AND 
CP.  LOCATION  ON  LATERAL  POSITION 
DEVIATION  (RANDOM  WIND  GUST) 
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<G  1 100  DEG) 


FIG.  6 EFFECTS  OF  CONTROL  SENSITIVITY  AND  C.P.  LOCATION  ON 
YAW  ANGU  DEVIATION  (RANDOM  WIND  GUST) 
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C.  P.  LOCATION  (%  WHEELBASn 

FIG.  7 COMBINED  EFFECTS  OF  UNOERSTEER 
AND  C.  P.  LOCATION  ON  YAW  ANGLE 
DEVIATION  IRANDOM  WIND  GUST) 
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CONTROL  SENSITIVITY 
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FIG.  8 EFFECTS  OF  UNDERSTEER,  CONTROL  SENSITIVITY,  AND 
C.P.  LOCATION  ON  STEERING  WHEEL  DEVIATION  (RANDOM 
WIND  GUST) 
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FIG.  9 COMBINED  EFFECTS  OF  UNDERSTEER  AND  C.P.  LOCATION 
AND  OF  CONTROL  SENSITIVITY  AND  C.P.  LOCATION  ON 
STEERING  WHEEL  DEVIATION  (RANDOM  WIND  GUST) 
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PEAK  LANE  POSITION  OVERSHOOT  Icm) 
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FIG.  10  EFFECTS  OF  C.P.  LOCATION,  CONTROL  SENSITIVITY,  AND 
UNDERSTEER  ON  PEAK  UNE  POSITION  OVERSHOOT  (STEP 
WIND  GUST) 
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Summary 

A twin-grip  control  yoke  was  designed  as  an  ergonomic  cose  study  that  allows 
dual  axis  control  inputs,  both  axes  being  rotational,  inputs  are  effected  by  rotating 
the  grips.  It  will  be  reported  how  the  handies  were  designed  with  respect  to  their 
shape  and  size  and  how  the  angular  range  of  the  control  yd<e  in  both  rotational 
axes  was  evaluated. 

The  hand  grip  design  is  based  on  the  anthropometric  data  of  the  hand.  The  main 
parameters  For  the  layout  are  the  breadth  of  the  hand,  the  grip  circumference,  and 
the  thumb  length.  The  steering  task  for  which  the  control  ydce  is  designed  requires 
that  the  grip  shape  takes  into  account  task  relevant  grip  characteristics,  such  as  a 
rest  for  hand  and  thumb  as  well  as  a thumb  operated  switch  button.  One  of  the  design 
requirements  is  the  Full  use  of  the  available  motion  range  for  steering  inputs  in  the 
two  rotational  axes  which  is  limited  by  the  human  arm-hand-system. 

Using  EMG  activities,  which  were  measured  at  the  forearm,  the  permissible 
pitch  and  roil  angles  of  the  control  ydce  were  evaluated  to  be  jH  30  . The  limita- 
tion stems  exclusively  from  the  combined  limits  of  the  radial  and  ulnar  ranges  of 
abduction  of  the  human  wrist  joint.  It  should  be  pointed  out  that  in  this  study  the 
control  range  was  not  limited  by  muscle  fatigue  which  is  also  measurable  with  EMG 
but  rather  by  EMG  levels  which  avoid  painful  loads  on  tendon  and  ligament  struc- 
tures. The  experimental  series  is  based  on  an  isotonic  rotation  in  both  axes.  EMG 
activities  were  only  mecaurable  under  extreme  angles  of  deflection.  If  the  operator 
has  to  deflect  the  control  element  from  its  neutral  position  against  a spring  resistance 
a further  reduction  of  the  operational  range  will  be  expected. 

Introduction 


In  this  study,  a control  yoke  which  requires  two-hand  operation  was  tested  to 
detemiine  its  operating  ranges.  The  intention  of  this  investigation  was  to  find  out 
the  optimal  form  of  the  control  yoke  and  the  maximum  permissible  operating  range  in 
both  rotating  axes.  In  these  experiments  controls  had  no  spring  resistance.  Future 
studies  will  involve  controls  with  spring  resistance. 

pjim^tmHvomLvy 


297 


The  control  yoke  has  two  rotating  axes.  Vehicle  direction  changes  to  rtie  left 
or  right  are  accomplished  by  turning  the  yoke  os  with  a steering  wheel  of  an  auto- 
mobile, called  here  roll  motion.  Vertical  vehicle  direction  changes  are  accomplished 
by  rotating  the  yoke  handles  towards  or  o*//ay  from  the  operator  which  will  be  called 
pitch  motion. 


Figure  1 : Influence  of  roll  axis  rotation  of  a twin  grip  control  yoke 
on  radial  and  ulnar  abduction  angles  of  both  hands 

In  the  left  of  the  upper  row  of  figure  1 is  to  be  seen  the  neutral  position  and 
in  the  middle  and  right  pictures  of  this  row  the  extreme  excursion  during  the  pitch 
movement.  These  two  pictures  Illustrate  the  biomechanical  position  limits  of  the  hand 
when  rotating  the  yoke  towards  and  away  from  the  operator.  The  pitch  motion  of  the 
hand  towards  the  operator  is  accomplished  by  radial  abduction ; pitch  motion  away 
from  the  operator  is  accomplished  by  ulnar  abduction.  Similar  hand  positions  are  shown 
in  the  lower  row  of  pictures  with  a 45^  roll  angle  position  coupled  with  neutral,  ra- 
dial and  ulnar  pitch  abduction. 

With  0°  pitch  angle  and  roll  motion  to  the  right,  radial  pre-abduction  will 
have  occured  in  the  right  hand  and  some  ulnar  pre-abduction  in  the  left  hand,  there- 
by restricting  the  available  amount  of  further  abduction  for  pitch  command  purposes. 

It  can  be  shown  that  with  increases  in  roll  motion  to  the  right  pre-abduction  will 
increase  until  biomechanical  limitations  make  pitch  commands  impossible  or  very 
difficult.  Similar  pre-abduction  occurs  with  left  roll  motions. 
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Biomechonlcal  consideration  of  the  arm* hand-system 

Figure  2 illustrates  the  abduction  range  of  the  hand.  In  the  left  part  of  the 
picture  there  is  shown  a hand  in  two  positions  holding  a stick.  The  hand  rotates  by 
an  assumed  axis  of  rotation  through  the  wrist  joint,  os  indicated  by  a small  circle. 
This  hand,  turned  8 to  12°,  corresponds  to  the  normal  resting  position  of  the  human 
hand. 


If  the  prolonged  center  line  of  the  forearm  is  considered  as  the  reference  line 
a natural  pre-abduction  of  the  hand  can  be  noticed.  The  values  given  in  the 
literature  [e.g.  1]  for  the  uirwr  and  radial  abduction  of  the  hand  are  bosed  on  this 
resting  position.  There  is  obviously  no  relationship  between  the  angle  at  which  the 
hand  is  in  the  natural  resting  position  and  the  maximum  range  of  abduction  of  the 
5th  to  95th  percentile.  On  the  right  part  of  the  figure  the  angle  range  is  shown  for 
the  radial  abduction  with  35®  and  for  the  ulnar  abduction  wUh  53°  measured  from 
the  resting  position  of  the  hand.  This  abduction  angle  of  88  is  equivalent  to  the 
90th  percentile. 


ulnar  abduction  radial  abduction 


naturol  hand  position  total  range  of  hand 

movement 
(90  th  percentile) 

Figure  2 : Abduction  range  of  the  hand 

If  9°  is  subtracted  , which  corresponds  to  the  natural  pre-abduction  from 
the  range  of  the  ulnar  abduction,  a value  of  44°  both  for  the  ulnar  and  for  the 
radial  angular  range  will  be  obtained.  This  consideration  is  important  for  practical 
applications  in  so  far  as  there  should  be  the  same  angular  range  in  radial  os  in  ulnar 
direction  for  the  pitch  movement,  i,e.  the  up  and  down  maneuver  of  the  vehicle. 

If  the  total  abduction  ability  of  the  hand  is  used  for  turning  a control  yoke,  two 
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rotational  axes  can  be  selected.  These  two  rotational  axes  of  the  control  yoke  cross 
in  the  steering  column.  In  figure  3 the  cose  is  shown  where  the  rototional  axis  of 
the  wrist  joint  is  equal  to  the  axis  of  the  control  element.  Consequently,  there  Is 
hardly  any  motion  of  the  forearm.  The  total  range  of  abduction  is  used  os  pitch  angle 
range,  that  is  for  radial  abduction  of  35^  and  for  ulnar  abduction  of  53^,  measured 
from  the  resting  position.  There  is  a light  disadvantage  of  forearm  movement  when 
the  rotational  axis  of  the  wrist  joint  does  not  correspond  with  the  rotational  axis 
of  the  hand  grip  for  small  and  large  hands.  This  effect  does  not  occur  If  the  rotational 


shouldtr  joint 


a)  rotational  axis  through  the  wrist  joint 


b)  rotatlonol  oxis  through  the  volar  hand 


Figure  3 : The  range  of  forearm  motion  for  different 
rotational  axes  of  the  control  yoke 
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ODcis  of  the  hand  grip  corresponds  with  the  center  of  the  hand  volar  or  palm  os  shown 
in  the  picture  below*  A pronounced  up  and  down  movement  of  the  forearm  which  re** 
suits  during  ulnar  and  radial  abduction  is  illustrated  in  figure  3.  Though,  radial  and 
ulnar  abduction  come  to  their  limits  at  88°  for  the  maximal  c^duction  of  the  90th 
percenHle,  the  maneuvering  pitch  angl^  range  only  reaches  68  , e.g.  27  for  radial 
and  41  for  ulnar  abductions  from  the  resting  position. 

Anthropometrical  Design  of  the  control  grip 

Figure  4 shows  the  operator  sitting  in  front  of  the  control  console.  The  angle 
of  inclination  with  respect  to  the  body  will  be  selected  in  a way  so  that  the  arm- 
hand-system  of  a 50th  percentile  operator  meosured  from  the  shoulder  reference  point 
is  in  a position  to  turn  the  control  yd<e  with  the  same  angular  values  in  ulnar  and 
radial  direction.  A control  yoke  is  shown,  the  rotational  axis  of  which  goes  through 
the  volar  hand. 


Figure  4 : Suggested  anthropometric  parameters  For  seated  operator  console 
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The  control  task  for  which  the  control  yoke  was  designed  requires  a specially 
shaped  grip  which  takes  into  account  task  relevant  grip  characteristics,  such  os  a 
hand  and  a thumb  rest  and  a switch  button  that  is  thumb  operated  (figure  5).  The 
design  of  the  grip  wck  based  on  the  95th  percentile  hand.  The  dimension  A of  the 
palm  was  based  on  hand  width.  The  hand  fits  between  the  hand  rest  and  the  top 
section  of  the  grip.  The  fingers  span  the  grip  slantwise  to  the  longitudinal  axis  of 
the  grip  and  not  in  parallel  fashion  os  they  would  with  a cone. 


switch  button 


Figure  5 : Anthropometric  parameters  for  designing  a hondgrip 


So  long  as  the  switch  button  is  not  used,  the  operator  con  smoothly  move  his 
hands  with  the  control  yoke  and  follows  its  motions.  Under  these  working  conditions 
the  hand  of  the  95th  percentile  man  is  resting  on  the  hand  support  and  the  thumb  is 
on  its  thumb  rest.  Smaller  hands  such  os  the  50th  or  5th  percentile  hands  can  use 
either  the  hand  rest  or  the  thumb  rest  os  a basic  working  position  during  the  control 
tosk. 


Figure  6 t Anthropometric  parameters  for  designing  o handgrip 
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The  basic  dimensions  of  the  grip  ore  the  dimensions  of  an  ideal  conical  bar 
which  was  first  used  1^  Henning*  Henning  su^ests  an  increase  in  radius  by  5 mm 
for  ea^  80  mm  in  length.  The  grip  is  finger  pCHraliel  and  the  forearm  ootis  is  ver- 
tical to  the  cone  cods.The  circumference  is  about  150  mm  for  a 95th  percentile  bond. 
As  can  be  seen  from  the  left  picture  of  figure  6 the  finger  tips  touch  lightly  the 
of^osite  port  of  the  hand  and  the  thumb  rests  on  ports  of  the  pointing  finger.  If  the 
cone  is  closed  the  fingers  are  inclined  to  the  longitudinal  okIs  of  the  cone*  A grip 
was  designed  using  finger  indentation  and  an  appropriate  deviation  of  the  cone  shc^ 
os  may  be  seen  In  figure  5. 

With  this  grip  the  finger  tips  of  the  95th  percentile  hand  are  at  smoll  but 
constant  distance  from  the  opposite  port  of  the  hand.  For  the  smaller  bonds  like 
50th  or  5th  percentile  hands  this  distance  becomes  larger  but  still  guaranties  a good 
form  closure.  With  this  design  a larger  thumb  rest  was  used  which  results  in  a sepa- 
ration of  the  possible  touch  between  the  thumb  and  the  fingers*  The  location  of  o 
switch  button  in  the  grip  head  was  based  on  the  thumb  length  of  the  50th  percentile 
hand.  Thumbs  which  are  longer  and  shorter  than  50th  percentile  ore  still  In  position 
to  operate  the  switch  button  by  use  of  lower  or  upper  ports  of  the  thumb  respec- 
tively. A concave  depression  in  the  top  section  of  the  grip  allows  sufficient  motion 
for  lorger  thumbs  when  pressing  the  switch. 

Biomechonicol  determinotion  of  the  operoting  ronge  of  the  twin-grip  control  yoke 

For  the  layout  of  a control  yoke  both  anthropometric  and  biomechanic  qual- 
ities of  the  hum<m  hand-arm  system  must  be  considered.  A method  is  proposed  in  this 
paper  which  permits  o detenminotion  of  a biomechonlcal  range  on  the  basis  of  sur- 
face electromyography  activities  which  are  involved  in  movement  and  force  exertion. 
At  the  limits  of  movement,  rather  hi^  EMG  activity  occurs  together  with  such  con- 
sequences as  muscle,  tertdon,  or  ligament  strain  anc^/or  pain. 

For  EMG  meosurements,  sub|ects  were  instructed  to  grip  the  yoke  lightly  with 
both  hands  so  that  no  forearm  muscles  were  contracted.  For  each  selected  roll  angle 
position  of  the  yoke,  the  control  was  then  slowly  moved  through  both  pitch  direc- 
tions* Row  EMG  signols  were  processed  with  a double  wove  rectifier  end  o speciol 
overoging  filter  [ 2,  3,  4T  . 

EMG  activity  for  the  right  bond  in  o number  of  different  roll  ongle  positions 
are  illustrated  in  figure  7 ns  o tunction  of  pitch  angles  for  roll  angles  in  the  right 
direction.  The  curves  illustrated  are  only  for  EMG  values  recorded  during  increasing 
pitch  angles  as  these  represent  the  worst  case  for  control  evoluotion. 

The  upper  EMG  volue  of  **1**  unit  was  arbitrarily  given  to  the  EMG  level  ob- 
toined  when  wrist  joint  poin  wos  experienced  after  repeotedly  holding  an  ongle  po- 
sition for  a fsw  seconds.  The  maximum  value  of  the  curves  (approx.  .75  units)  is 
obtained  at  the  maximum  pitch  angle  which  was  measured.  The  moximum  pitch  angle 
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FIgura  7 : octtvitfes  of  rodiot  ond  oinor  abductor)  of  o right  bond  with 

90^  porcontlle  wrist  movoment  rouge  os  o function  of  pitch  ongle 
for  vorlous  roil  ongles*  Roll  movement  Is  In  rlg^t 
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Figure  8 t EMG  octlvlHes  of  rodlol  ond  ulnor  obduetors  of  o right  hand  with 
90*h  percentile  wrist  movement  ronge  os  o function  of  pitch  ongle 
for  vorlous  roll  angles.  Roll  movement  Is  In  left 
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meoiured  w«  selected  offer  experimentally  determining  the  maximum  pitch  angle  ot 
which  no  wrist  pain  build-up  occured  during  fairly  long  measuring  sessions.  For  any 
given  pitch  angle  there  is  a tendency  for  gre-obduction  to  be  larger  with  larger  con- 
stcmt  roil  ongles*  It  con  be  seen  that  at  roil  angle  the  full  range  of  possible  wirst 
movement  of  the  sub{ect  ccm  be  used  for  pitch  ccmmonds  in  both  directions  becouse 
there  is  no  pre-obduction.  At  60^  roll  ongle  to  the  right,  rodiol  pre-obduction  Is  so 
large  that  no  pitch  angle  movement  in  this  "pull  up**  direction  is  possible,  in  the 
right  side  of  the  figure  the  EMG  curves^fcr  ulnar  abduction  t.e.  in  the  '’push  down" 
direction  is  illustrated.  The  45^.01x1  60^  roll  ongle  permit  reiotively  large  "pull  up" 
commands  oithough  the  curves  do  not  rise  as  high  as  those  for  radial  abduction  on 
the  left  side  of  the  figure.  The  reason  for  this  Is  thot  ulnor  abduction  of  the  left 
hand,  which  is  not  Illustrated,  reaches  o limit  at  these  pitch  ongles  before  the  right 
hortd,  thereby  preventing  further  ulnar  abduction  of  the  right  hand*  Of  course,  re- 
leoM  of  the  control  the  left  hand  would  hove  permitted  further  movement. 


EMG  values  for  ulnar  ond  rodiol  abduction  of  the  right  bond  is  si'own  in  fig- 
ure 8 for  left  roil  ot  vcxious  roil  ongles.  As  can  be  seen  on  the  left  side  of  the 
figure  for  left  roll,  right  hand  "pull-up"  pitch  commands  or  rodiol  abduction  move- 
ment is  so  severely  limited  by  rodiol  pre-obduction  of  the  left  hand  in  oil  roll  angle 
positions  except  0^  thot  further  movements  ore  not  possible.  The  ronge  of  ulnor  ob- 
duction  or  "push-dewn"  commands  illustrated  on  the  right  side  of  the  figure  is  slightly 
reduced  by  ulnor  pre-obduction  thereby  oiiowing  considerable  movement  before  the 
ulnor  abduction  limits  are  reached. 


Discussion  of  the  EMG-meosurements 


In  designing  o ronge  for  this  control  device  the  following  points  ore  the  most 
important  to  consider.  I.  It  should  permit  the  lorgest  possible  pitch  ongle  in  both 
directions  for  each  of  the  largest  possible  roll  ongles  for  subjects  with  5th  percentile 
wrist  movement  ronges.  2,  Only  lower  levels  of  ^G  activity  should  occur  most  of 
the  time  during  control  operotions.  Moderate  EMG  octivlty  levels  should  occur  very 
briefly  and  no  high  EMG  octivlty  ot  oil. 

As  can  be  noticed  in  the  figure  7 and  8 these  requirements  con  be  satisfied 
for  the  subject  tested  with  roll  and  pitch  angle  ronges  of  approx,  4 30^  eoch  (ot 
which  no  more  than  0,5  units  of  EMG  activity  ore  reoched).  It  sIxMld  be  pointed 
out  that  In  this  study  the  control  ronge  was  not  determined  1^  muscle  fatigue  limits 
which  ore  olso  measurable  with  EMG  but  rather  by  EMG  levels  which  ovoid  pain- 
ful loads  on  tendon  ond  ligoment  structures.  The  ^G  measuring  method  presented 
proved  to  be  a voluoble  objective  old  for  determining  an  odvontogeous  control  ronge. 
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SUMMARY 


This  paper  considers  the  problem  of  constructing  event-related 
information  displays  from  multidimensional  data  generated  by  proximity, 
force-torque  and  tactile  sensors  integrated  with  the  terminal  device  of  a 
remotely  controlled  manipulator.  Event-driven  displays  are  constructed  by 
using  appropriate  algorithms  acting  on  sensory  data  in  real  time.  The  purpose 
of  event-driven  information  displays  is  to  lessen  the  operator’s  workload  and 
to  improve  control  performance.  The  paper  describes  and  discusses  several 
event-driven  display  examples  that  have  been  implemented  in  the  JPL  tele- 
operator project,  including  a brief  outline  of  the  data  handling  system  which 
drives  the  graphics  display  in  real  time.  One  application  shows  the  integra- 
tion of  a set  of  four  proximity  sensors  with  a JSC  four-claw  end  effector  for 
the  shuttle  manipulator  training  facility  of  JSC.  The  paper  concludes  with  a 
discussion  of  future  plans  to  integrate  event-driven  displays  with  visual  (TV) 
information. 


1.  INTRODUCTION 


The  objective  of  this  paper  is  to  show  and  discuss  display  techniques 
aimed  at  reducing  the  dimensionality  of  proximity,  force-torque  and  tactile 
sensor  data,  and  conveying  the  sensory  information  to  the  operator  of  a remote 
manipulator  in  terms  of  significant  events  related  to  the  control  task.  An 
event-driven  display  is  a display  which  shows  whether  or  not  some  desired 
state  of  the  teleoperator  effectors/sensors  has  been  achieved.  It  may  or  may 
not  show  the  details  of  the  state  itself,  rather  it  displays  the  occurrence 
of  the  event.  Hence,  event-driven  displays  compress  and  explicitly  indicate 
sensory  data  in  terms  of  control  goals  or  subgoals  which  require  specific 
control  decisions  and  actions. 

The  general  problem  of  displaying  information  generated  by  proximity, 
force-torque,  tactile  and  slippage  sensors  integrated  with  the  terminal  device 
of  a mechanical  arm  has  been  treated  in  a previous  paper  (see  Reference  1). 


*)  This  work  represents  one  phase  of  research  carried  out  at  the  Jet  Propul- 
sion Laboratory,  California  Institute  of  Technology,  under  Contract  No. 
NAS7-100,  sponsored  by  the  National  Aeronautics  and  Space  Administration. 
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The  information  generated  by  these  sensors  is  basically  non-visual:  short 

(few  centimeters)  distances  in  given  direction  between  terminal  device  and 
object;  amount  of  force  and/or  torque  exerted  by  the  terminal  device  on 
objects  along  three  orthogonal  axes  referenced  to  the  terminal  device;  dis- 
tribution and  amount  of  contact  area  pressure  between  terminal  device  and 
object;  or  slip  of  an  object  in  some  direction  on  the  inner  surface  of 
mechanical  “fingers”.  Hence,  the  general  problem  and  objective  of  displaying 
this  type  of  information  to  the  operator  of  a remote  manipulator  are  to  make 
non-visible  events  visible  or,  alternatively,  to  make  non-visible  events 
easily  perceivable  by  using  some  appropriate  means  (e.g.,  audio  tones). 

The  information  generated  by  proximity,  force-torque,  tactile  and 
slippage  sensors  has  two  specific  features;  it  is  multidimensional,  and  it 
requires  quick  (sometimes  split-second)  decision  or  control  response.  It  is 
noted  that,  in  general,  the  required  decision  or  control  response  is  also 
multidimensional.  The  use  of  multidimensional  data  with  quick  response 
requirements  in  a real  time  manual  or  computer  control  environment  is  a 
demanding  perceptual  and  cognitive  workload  for  the  operator  of  a remote 
manipulator.  It  is  a major  source  of  errors,  and  can  result  in  a general 
degradation  of  control  performance.  The  purpose  of  event-driven  sensory 
information  displays  is  to  lessen  the  operator's  workload  and  to  improve 
overall  control  performance  of  remote  manipulators. 

The  concept  of  sensory  information  “events”  is  discussed  in  Section  II. 
The  general  features  of  “event-driven  displays”  are  briefly  discussed  in 
Section  III.  Section  IV  describes  several  event-driven  display  examples  that 
have  been  implemented  in  the  JPL  teleoperator  project.  These  Include  two 
uses  of  four  proximity  sensors  and  a single  use  of  a six-dimensional  force- 
torque  sensor  integrated  with  manipulator  end  effectors  employing  both  audio 
and  graphic  display  techniques.  One  application  shows  a set  of  four  proxim- 
ity sensors  integrated  with  a JSC  four-claw  end  effector  to  be  used  at  the 
JSC  Manipulator  Development  Facility.  A simple  touch  sensor  example  is  also 
described.  The  concluding  Section  V summarizes  the  results  and  outlines 
future  plans  to  integrate  event-driven  displays  with  visual  (TV)  information. 
A brief  description  of  the  data  handling  system  which  drives  the  graphics 
displays  in  real  time  is  presented  in  the  Appendix. 


II.  SENSORY  INFORMATION  “EVENTS” 


Proximity,  force-torque  and  touch  sensor  data  are  inherently  multi- 
dimensional. A six-dimensional  force-torque  sensor  outputs  the  time  trajec- 
tories of  three  orthogonal  force  and  three  orthogonal  torque  components 
normally  referenced  to  a hand  coordinate  frame.  The  hand  coordinate  frame 
itself  is  a variable  (i.e.,  has  time  trajectories)  relative  to  a fixed  “base” 
reference  frame.  A multipoint  proportional  touch  sensor  measures  the  area 
distribution  and  amount  of  contact  pressure  over  a fixed  surface.  A single 
proximity  sensor  measures  short  (few  centimeters)  distances  in  a given  direc- 
tion relative  to  a hand  coordinate  frame.  Several  proximity  sensors  in  a 
given  emplacement  geometry  on  the  hand  can  measure  several  or  all  six 
position  and  orientation  variables  of  the  hand  relative  to  objects. 
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A sensor-referenced  or  sensor-guided  manipulator  control  task  contains  a 
goal  or  a set  of  subgoals.  The  control  goal  or  subgoals  are  expressed  as  a 
combination  of  various  sensory  data.  The  simultaneous  occurrence  of  time 
trajectories  of  various  sensory  data  at  a single  point  or  within  a given  sub- 
volume of  a multidimensional  data  space  can  he  called  a sensory  information 
"event".  Hence,  sensory  information  "event"  is  the  projection  or  mapping  of 
the  control  goal  or  subgoals  into  a multidimensional  data  space. 

Figure  1 gives  simple  illustrations  for  the  concept  of  sensory  informa- 
tion "event".  Equal  length  of  two  proximity  sensor  beams  can  be  an  "event" 
in  the  sense  that  it  may  signify,  e.g.,  the  roll,  yaw  or  pitch  alignment  of 
a mechanical  hand  relative  to  an  object.  Equal  magnitude  of  two  orthogonal 
force  components  can  be  an  "event"  in  the  sense  that  it  may  signify,  e.g., 
the  push  or  pull  of  an  object  by  a mechanical  hand  in  a given  direction.  Or, 
for  instance,  half  contact  coverage  of  a touch-sensitive  area  on  a mechanical 
finger  can  be  an  "event"  in  the  sense  that  it  may  signify,  e.g.,  that  there 
is  sufficient  contact  between  hand  and  object  for  successful  grasp. 

The  operator’s  attention  in  both  manual  and  computer  control  is  normally 
focused  at  the  control  goals  or  subgoals,  that  is,  at  the  sensory  information 
"events".  Typically,  when  such  "events"  occur,  some  control  action  must  be 
taken.  It  is  to  the  operator’s  advantage  to  have  these  sensory  "events"  dis- 
played in  easily  perceivable  and  unmistakably  unique  forms.  In  the  absence 
of  such  "event"  displays,  the  operator  must  determine  the  occurrence  of  the 
"event"  by  following  and  evaluating  a multidimensional  set  of  data  in  real 
time.  This  is  not  only  a demanding  task  and  heavy  workload  for  the  operator, 
but  also  a common  source  of  errors. 


III.  DISPLAY  OF  "EVENTS" 


Event-driven  displays  can  be  implemented  by  developing  and/or  employing 
appropriate  real-time  algorithms  which  (a)  coordinate  and  evaluate  sensor 
data  in  terms  of  predefined  "events"  and,  (b)  drive  some  appropriate  informa- 
tion display  in  real  time.  Manipulator  control  tasks  can  be  subdivided  into 
a multitude  of  sensory  "events",  and  each  event  may  have  a variety  of  charac- 
teristic parameters.  Thus,  the  development  of  fairly  general  purpose  event- 
driven  displays  requires  that  the  logic/parametric  structure  of  the  algo- 
rithms be  flexible  in  the  sense  that  changing  control  goals  or  subgoais  can 
be  acconunodated  by  simple  call-changes  in  the  algorithms  in  a given  control/ 
operation  environment. 

The  actual  event  display  can  be  implemented  by  alternative  means,  the 
selection  of  which  depends  on  the  application  environment.  For  event 
displays,  both  audio  and  visual  display  techniques  are  suitable.  An  impor- 
tant consideration  for  selecting  or  designing  event  displays  is  the  "warning 
effect"  the  display  can  or  shall  impose  on  the  operator.  By  definition,  the 
occurrence  of  a sensory  event  should  call  the  operator’s  attention  to  some 
appropriate  control  decision  or  control  action,  without  disturbing  his  normal 
visual  attention  directed  toward  the  overall  control  task.  Note  that  the 
control  can  require  split-second  decisions.  Another  Important  consideration 
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is  related  to  the  selection  of  the  content,  of  the  display  format.  How  much 
and  what  kind  of  detailed  information  the  operator  should  be  exposed  to  in 
addition  to  the  **event  information"  within  the  same  general  frame  of 
information?  Too  much  Information  can  be  disturbing.  Too  little  information 
can  defy  the  purpose.  The  display  of  uncorrelated  data,  or  the  display  of 
correlated  data  in  uncorrelated  form,  may  impose  heavy  cognitive  load  on  the 
operator. 

Properly  designed  event-driven  displays  are  expected  to  have  a number  of 
benefits:  (a)  simplify  on-line  control  decisions;  (b)  reduce  errors  caused 

by  human  factors;  (c)  reduce  perceptual/cognitive  workload  on  human  operator 
in  a real-time  control  environment;  (d)  improve  overall  control  performance 
in  control  situations  which  many  times  require  split-second  type  control 
decisions. 


IV.  EXAMPLES 


A.  Event-Driven  Proximity  Displays 

Event-driven  displays  have  been  constructed  for  proximity  sensors  on 
two  arms  in  the  JPL  teleoperator  project,  and  also  for  a proximity  sensor 
system  developed  at  JPL  and  integrated  with  the  four-claw  end  effector  of 
JSC  to  be  used  at  their  shuttle  manipulator  training  facility. 

1 . JPL  Teleoperator  Arms 

Both  the  JPL/CURV  and  JPL/Ames  arms  are  equipped  with  four  proximity 
sensors,  and  the  event-driven  display  developed  recently  is  applicable  to 
both  sensor  systems.  Although  the  sensor  hardware  is  quite  different  on  the 
two  arms,  the  sensor  display  drive  software  is  common  except  for  the  routines 
that  get  the  data.  Similarly,  the  event  logic  is  common.  The  details  of  the 
computer  hardware  and  software  are  described  in  the  Appendix. 

The  general  format  of  graphics  display  of  four  proximity  sensors  data  is 
shown  in  Figure  2.  The  display  shows  a view  of  the  "bone"  of  a parallel  jaw 
hand  and  four  beams  emanating  from  the  hand,  two  from  each  jaw.  The  beam 
lengths  are  proportional  to  the  sensitive  length  of  the  sensor  beams.  Each 
beam  length  is  bound  to  10  cm  (4  in.). 

Figure  3 summarizes  the  proximity  events  together  with  the  event  logic 
and  event  parameters  that  have  been  implemented.  In  the  present  implementa- 
tion the  parameter  D is  fixed  at  5 cm.  D is  always  defined  parallel  to  and 
halfway  in  between  the  two  beams  which  measure  roll  and  yaw  alignments, 
respectively,  and  relative  to  the  line  connecting  the  two  fingertips.  The 
tolerance,  T,  can  be  set  by  switch  inputs  on  the  computer's  front  panel. 
Values  from  0.5  to  7*5  cm  are  allowed.  Any  combination  of  the  four  event 
logic  equations  may  be  selected  to  control  the  event  success  blinker.  The 
success  may  be  defined  as  X alignment  with  a tolerance,  say,  of  1 cm  (corres- 
ponding to  about  5 degrees  when  the  hand  is  fully  open).  Or,  the  success  may 
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be  defined  as  Y range  of  5 cm  together  with  X alignment  to  within  0.5  cm 
tolerance  (corresponding  to  about  2 . 5 degrees  when  the  hand  is  fully  open) . 
This  latter  "success  case"  would  be  useful  in  moving  the  hand  over  a table 
to  a wall  while  holding  an  object  vertical.  With  this  event  logic,  the  hand 
roll  angle  would  be  small  as  the  range  measurement  is  made  on  both  sensors 
and  the  object  would  be  held  with  the  hand  5 cm  aboye  the  table.  The  final 
approach  to  the  wall  would  be  reached  with  the  hand  perpendicular  to  the  wall. 

The  event  Indicator  blinker  has  initially  been  placed  in  the  top  left 
hand  corner  of  the  monitor  screen.  Though  all  four  sensor  beams  are  shown  on 
the  monitor,  the  operator  does  not  have  tc  evaluate  the  four  beams  quantita- 
tively in  terms  of  a predefined  event.  This  is  done  for  him  by  the  display 
drive  logic  automatically  and  in  real  time.  He  can  take  a more  qualitative 
look  at  the  four  beams  to  determine,  e.g.,  why  the  success  blinker  is  "off"; 
that  is,  what  to  do  in  order  to  get  the  success  blinker  "on". 

Figure  4 shows  two  uses  of  the  event-driven  proximity  display.  The 
first  pair  of  photographs  (Figure  4A)  shows  the  hand  above  a table  and 
skewed  to  a block.  The  task  is  to  achieve  alignment  with  the  table  and  the 
block.  The  display  shows  the  operator  how  to  bring  the  hand  perpendicular 
to  the  block  while  maintaining  the  hand  level  at  5 cm  above  the  table.  The 
second  pair  of  photographs  (Figure  4B)  shows  that  this  has  occurred  and  the 
event  blinker  has  come  on.  The  third  pair  of  photographs  (Figure  4C)  shows 
a different  alignment  problem.  Here,  it  is  desired  to  bring  the  hand  in 
level  over  the  plate  on  the  table.  There  are  no  forward  references.  Follow- 
ing the  required  corrections  as  indicated  by  the  display,  the  desired  level 
state  is  achieved,  and  the  event  blinker  comes  on  as  shown  in  the  fourth  pair 
of  photographs  (Figure  4D) . 

While  the  two  uses  of  the  event-driven  display  shown  in  Figure  4 are 
simple,  they  do  demonstrate  the  usefulness  of  the  concept.  As  more  complex 
tasks  are  performed  and  analyzed,  a detailed  examination  of  the  benefits  can 
be  made.  Future  improvements  in  implementation  are  also  planned  to  enable  a 
broader  variety  of  events  to  be  defined.  Ranges,  alignment  angles  and  toler- 
ances could  be  individually  defined  rather  than  being  commonly  constrained 
as  at  present. 

2.  JSC  Four-Claw  End  Effector 


A proximity  sensor  has  been  developed  for  and  Integrated  with  a four- 
claw  end  effector  of  JSC.  The  purpose  of  this  sensor  system  is  to  aid  the 
operator  to  find  the  proper  final  depth  positioning  and  pitch  and  yaw  align- 
ments of  the  four-claw  end  effector  on  a 16-m  long  manipulator  relative  to 
the  grapple  fixture  of  a large  payload.  The  overall  control  is  visually 
guided. 

The  sensor  system,  together  with  the  grasp  envelope  and  measurement 
definitions  are  shown  in  Figure  5.  The  use  of  the  sensor  system  is  presently 
restricted  to  the  verification  of  a "successful  grasp  state"  before  grasp 
action  is  initiated.  The  "successful  grasp  state"  is  defined  by  the 
dimensions  of  the  grasp  envelope  (see  Figure  5)  and  by  the  dynamics  of  grasp. 
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When  a ''successful  grasp  state"  has  been  reached,  the  data  processing 
electronics  automatically  turns  on  a simple  "success  display"  (a  buzzer  or 
a green  light,  or  both),  indicating  to  the  operator  that  he  Is  ready  to 
grasp. 


The  data  processing  required  to  drive  the  "success  display"  has  two 
modes:  analog  and  digital.  The  analog  drive  logic  implementation  is  quite 

simple  as  indicated  in  Figure  6.  In  fact,  with  this  simple  analog  implemen- 
tation the  full  capabilities  of  the  sensor  system  cannot  be  utilized  to 
account  for  all  physically  possible  combinations  of  depth,  pitch  and  yaw 
error  states  which,  due  to  the  dimensions  of  the  end  effector's  grasp  enve- 
lope, still  would  allow  successful  grasp.  To  achieve  a full  utilization  of 
the  sensor  system  capabilities  versus  all  allowable  depth,  pitch  and  yaw 
error  combinations,  "success  algorithms"  have  been  developed  and  implemented 
using  an  Intel  80/20-4  single-board  microcomputer  together  with  an  Intel 
single-board  A/D  converter. 

For  the  purpose  of  experimentation,  several  "success  algorithms"  have 
been  implemented  in  the  digital  computer  to  drive  the  displays.  The  algo- 
rithms are  simple,  and  account  for  all  (or  for  almost  all)  allowable  error 
states  combinations  for  successful  grasp.  Algorithms  have  also  been  imple- 
mented which  utilize  the  outputs  of  any  three  out  of  the  four  sensors  to 
indicate  the  "success  states".  This  is  useful  if  one  sensor  eventually 
falls,  or  if  one  sensor  eventually  misses  the  top  (reference)  surface  of  the 
grapple  fixture  due  to  allowable  lateral  alignment  errors.  (Note  that  the 
four-sensor  configuration  is  redundant  to  define  and  compute  depth,  pitch 
and  yaw  errors.  A triangular  configuration  of  three  sensors  would  be 
sufficient  for  that  purpose.) 

For  the  sake  of  brevity,  only  one  "success  algorithm"  is  shown  in  this 
paper,  summarized  in  Figure  7.  It  is  called  "conic  algorithm"  since  it  con- 
denses the  individually  allowable  pitch  and  yaw  errors  into  a simple  allow- 
able cone  angle  error  condition.  (See  Condition  2 in  Figure  7.)  Three  kinds 
of  "success  definitions"  have  been  developed,  each  with  three  sets  of 
"success  parameters".  All  nine  variations  have  been  implemented  for  "all 
four"  and  for  "three-out-of-four"  sensors.  All  together  18  algorithms  are 
stored  in  EPROM  in  the  microcomputer.  Any  one  of  the  18  algorithms  are 
easily  callable  by  dialing  the  appropriate  number  between  1 and  18  on  a BCD 
switch  integrated  with  the  microcomputer. 

Very  successful  operational  ground  tests  have  been  conducted  with  the 
sensor  and  simple  display  system  at  JSC  using  the  16-m  long  arm  of  the 
JSC  Manipulator  Development  Facility  in  realistic  large  payload  handling 
experiments.  Fig.  8 shows  a floor  set-up  scene  (direct  visual  contact  with 
target)  for  capturing  a moving  target.  All  together  112  test  runs  have  been 
performed  by  4 operators.  Hie  final  result  is  that,  when  the  "success  dis- 
play" (tone  or  green  light)  was  on,  the  operators  got  a capture  every  time. 
There  were  no  operator  mistakes  under  sensor-indicated  grasping  conditions, 
and  the  sensors  never  indicated  wrong  conditions  for  grasping.  Three  of  the 
four  operators  favored  the  buzzer  for  "success  display".  The  utility  of  the 
display  increased  with  task  difficulty.  The  display  was  required  to  aid  the 
operator  to  successfully  complete  the  most  difficult  tasks  without  error. 
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The  simple  success  display  (tone  or  green  light)  does  not  show  the 
details  of  the  three-dimensional  (depth,  pitch  and  yaw)  error  states.  Advan- 
ced graphics  display  concepts  have  been  developed  and  Implemented  recently 
using  the  JPL  teleoperator  breadboard  system  to  experiment  with  various 
formats.  The  advanced  formats  have  been  designed  to  convey  to  the  operator  , 
net  only  the,  "success"  Information  but  also  the  details  of  the  three  (depth, 
pitch  and  yaw)  errors  so  that  the  operator  will  know  from  the  sensors  "what 
to  do"  in  order  to  get  to  the  "success"  state  or  to  fine-control  the  grasp. 
Fig.  9 shows  an  advanced  "success  display"  concept  implemented  in  color 
graphics.  Success  is  indicated  here  by  all  error  bars  turning  green.  The 
unsuccessful  error  combinations  are  indicated  by  all  error  bars  turning  red. 
The  length  of  the  error  bars  is  proportional  to  the  respective  errors  under 
both  "green”  or  "red"  conditions. 

B.  Event-Driven  Force-Torque  Display 

Fig.  10  shows  a six-dimensional  force-torque  sensor  Integrated  with  the 
JPL/CURV  arm.  The  sensor  mechanism  has  been  built  by  Vlcarm  Inc.  The  sensor 
electronics  and  data  handling  have  been  developed  at  JPL,  More  details  of 
this  sensor  system  can  be  found  in  Ref.  2.  Fig.  10  also  shows  a graphics 
display  format:  each  force  and  torque  component  is  displayed  both  numeri- 

cally and  graphically.  The  length  of  the  bars  is  proportional  to  the  value 
of  the  respective  force  or  torque  components.  The  bars  originate  from  the 
center  vertical  line  on  the  screen.  To  the  left  from  this  center  line  the 
force-torque  field  is  negative,  to  the  right  it  is  positive.  The  force- 
torque  components  are  referenced  to  a hand-based  coordinate  frame.  The  force- 
torque  distribution  seen  on  the  graphics  display  of  Fig.  10  actually  shows 
the  forces  and  torques  felt  at  the  hand  base  while  the  hand  is  pushing  the 
object  as  Indicated  on  the  same  figure.  As  seen,  a simple  push  scene  can 
generate  a rather  complex  force-torque  relation  felt  at  the  hand  base. 

The  application  of  event-driven  displays  to  force-torque  sensor  data  will 
significantly  enhance  the  use  of  that  data  type  under  manual  or  computer  aided 
control.  The  events  marked  can  show  complex  relationships  between  forces  and 
torques  alone  or  in  combination.  Further,  when  the  desired  force-torque 
events  are  not  existing,  the  display  format  can  be  changed  to  show  the  opera- 
tor what  has  to  be  done  to  reach  the  desired  state.  A simple  example  can 
best  Illustrate  the  concept. 

Consider  the  task  of  sliding  a block  in  a groove  across  a table  by  push- 
ing it.  (See  Fig.  11)  The  applied  forces  must  be  in  the  direction  of  the 
groove  if  the  block  is  to  be  moved  efficiently  and  safely.  Fig.  11  also 
shows  an  appropriate  "event-driven"  display.  t<hen  the  forces  are  applied 
correctly,  the  operator  will  know  it  by  the  event  Indicator.  If  not,  the 
operator  will  see  the  force  errors  and  be  able  to  apply  the  needed  correc- 
tions. Practical  application  and  demonstration  are  needed  before  the  bene- 
fits of  this  display  concept  can  be  fully  documented. 

An  interesting  use  of  even-driven  displays  is  to  signal  the  operator  to 
switch  displays.  Say,  for  example,  it  is  necessary  to  move  a manipulator  to 
an  object  and  then  move  the  manipulator  into  contact  with  the  object  without 
knowing  the  exact  position  of  the  object  beforehand,  or  having  specially 
positioned  TV’s  showing  all  the  necessary  views. 
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With  event-driven  displays,  the  task  could  be  performed  as  follows: 
using  a proximity  event  display  set  in  a position  sensing  mode,  the  operator 
moves  the  manipulator  rapidly  towards  the  object.  When  signalled  that  the 
manipulator  is  near  the  object,  the  operator  slows  its  motion  and  switches 
the  display  to  a force/torque  even  mode.  When  contact  has  been  achieved,  the 
operator  is  again  signalled  before  the  forces  reach  an  unacceptable  level. 
Thus,  event-driven  displays  used  in  combination  hold  great  promise  for  even 
greater  benefits  in  that  tasks  can  be  performed  more  rapidly,  more  reliably 
and  with  lower  expenditure  of  resources. 

C.  Event-Driven  Touch  Display 

The  touch  sensor  unit  being  used  here  has  two  4 by  8 matrices  of  points 
that  can  sense  applied  pressures.  These  matrices,  or  perhaps  some  with  higher 
point  density,  can  be  mounted  on  the  inside  of  mechanical  fingers  (jaws)  and 
used  to  sense  contact  areas  or  the  location  of  points  of  contact  between  fin- 
ger and  object.  Similar  units  could  be  mounted  on  other  surfaces  to  sense 
other  contact  forces  or  patterns  of  contact  areas.  At  each  point  of  the  sen- 
sor matrix  the  pressures  applied  locally  are  sensed  by  measuring  the  conduc- 
tivity of  a pressure  sensitive  plastic.  The  measurement  concept  and  the 
actual  sensing  elements  are  shown  in  Fig.  12. 

Fig.  12  also  shows  the  basic  touch  sensor  displays.  The  numeric 
representation  of  the  sensor  output  gives  a more  quantitative  impression  of 
the  applied  forces  distribution  and  is  particularly  useful  for  diagnostic 
work.  The  color  or  B/W  shades  displays  are  more  graphic  and  are  easier  to 
understand  at  a glance  although  less  Information  is  presented. 

A particular  event-driven  touch  sensor  display  is  planned  to  be  imple- 
mented to  further  enhance  the  control  context  of  data  presented  to  the 
operator.  The  display  concept  (shown  in  Fig,  13)  is  aimed  to  give  a quanti- 
tative indication  to  the  operator  when  the  contact  area  Increases  by  pre- 
defined anwunt.  While  the  pressures  applied  will  still  be  shown  as  dark  or 
light  shades  of  a color,  the  color  itself  will  be  changed  to  reflect  the  total 
applied  pressure  over  a given  area.  The  matrix  displayed  may  be  red,  if  less 
than  half  the  sensitive  points  have  made  contact;  orange,  if  between  1/2  and 
3/4  have;  or  green,  if  more  than  3/4  have.  Thus,  a green  condition  will 
signify  a safe  grasp. 


V.  CONCLUSIONS 


1)  Performance  tests  conducted  at  JSC  with  a three-dimenaional  proxi- 
mity sensor  system  and  "go-no  go"  display  have  shown  the  basic  utility  of  a 
simple  event-driven  display  which  conveys  critical  control  Information  to 
the  operator  based  on  real-time  algorithmic  evaluation  of  multidimensional 
data. 


2)  In  general,  event-driven  displays  enhance  the  control  context  of 
sensory  Information  since  events  can  be  defined  with  respect  to  critical 
control  decisions  or  control  actions. 
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3)  Preliminary  experiments  strongly  Indicate  the  need  of  integrating 
visual  and  non>visual  sensory  information  within  a single  perception  format. 
This  may  require  the  development  of  TV. monitors  with  sensory  information  over- 
layed  to  or  cut  into  the  camera  Information. 

4)  Extensive  experimentation  is  needed  with  a multitude  of  event-driven 
display  formats  in  order  to  develop  a reliable  rating  of  the  different  for- 
mats. The  experimentation  will  by  necessity  encounter  questions  in  human 
factors^ engineering.  Presently  it  is  not  clear  what  kind  of  objective  mea- 
sures would  be  suitable  to  meet  the  challenges  in  the  performance  evaluation 

of  event-related  human  factors. 
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APPENDIX 


1*  Computer  Svstea 

A single  conputer  system  is  used  £or  software  development  and  display 
driving.  Its  principal  elements  are  shown  in  Fig.  14.  The  signals  to  be  dis~ 
played  can  come  from  any  of  five  sources:  JPL/AMES  arm  proximity  sensors, 
JPWCURV  arm  proximity  and  force-tor<)ue  sensors,  touch  sensors,  or  the  JSC  four*' 
claw  proximity  sensors.  (These  last  signals  come  through  an  Intel  80/20  pro* 
cesaor.)  The  display  computer  processes  these  signals  into  the  desired  display 
format  so  that  they  may  be  seen  in  color  or  in  B/N,  with  or  without  alpha-numeric 
text. 


The  display  computer  is  an  SlOO  bus  based  system  and  employes  a Z80  based 
processor  operating  with  a 4 MHZ  clock.  The  computer  communicates  to  the  outside 
world  through  a 7 channel  8 bit  A/D  converter,  2 serial  ports,  8 bit  parallel 
ports,  a dual  floppy  disk,  and,  of  course,  a graphics  color/BW  TV  display.  The 
operator  interface  is  through  an  AIM-3A  terminal,  a TTT  and  the  dual  disk. 

The  graphics  display  is  performed  by  DMA  on  a memory  map.  That  is,  the 
display  driver  circuitry  timing  operates  independently  from  the  main  program  and 
shares  the  memory  storing  to  the  screen  image.  Various  display  parameters  are 
under  program  control;  display  on/off,  point  density,  D/W  or  color,  etc.  The 
graphics  densities  employed  are:  64  by  64  color  and  128  by  128  B/W  for  the  touch 
sensor;  128  by  128  B/W  for  the  proximity  sensors  on  the  JPL/CDRV  and  Ames  atm 
and  for  the  force-torque  sensor  on  the  JPL/CDRV  arm;  and  64  by  64  color  for  the 
JSC  four  claw  proximity  sensors. 

The  signals  from  Che  JPL/Ames  arm  proximity  sensor  electronics  are  sent  to 
the  display  computer  on  4 analog  lines.  The  A/D  conversion  is  done  inside  the 
display  computer  by  an  8 bit  successive  approximation  converter.  Each  conver- 
sion takes  about  S pa. 

The  signals  from  both  sensors  (proximity  and  force-torque)  on  the  JPL/CURV 
arm  are  converted  to  12  bit  digital  words  in  Che  CDRV  vehicle  electronics  and 
then  stored  in  a buffer  memory  associated  with  the  Interdata  H70  minicomputer 
which  performs  control  and  supervisory  functions.  The  data  is  transferred  in 
parallel  Co  the  'isplay  computer  as  two  8 bit  words.  'Rie  data  to  be  transferred 
is  specified  by  the  address  sent  to  the  buffer  memory  from  the  display  computer. 

The  signals  from  the  touch  sensor  are  converted  to  12  bit  digital  words  by 
the  touch  sensor  electronics.  The  point  of  the  sensor  matrix  to  be  sampled  is 
under  control  of  the  display  conputer.  An  address  is  sent  to  the  touch  sensor 
electronics,  the  point  is  sampled,  and  the  data  is  sent  to  the  display  computer 
as  two  8 bit  %fords.  Due  to  the  handshaking  signals  which  are  under  software 
control,  Che  tdiole  process  takes  about  100  us. 

The  signals  from  the  JSC  four-claw  proximity  sensors  are  processed  by  the 
Intel  SBC  80/20-4  cosq>uter.  Only  the  pitch,  yaw,  and  range  error  signals  and  the 
**event"  signal  are  passed  over  to  the  display  computer.  These  signals  are 
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encoded  into  three  8 bit  parallel  words.  The  two  computers  run  asynchronously 
since  the  TV  graphics  display  process  is  much  slower  than  Che  event  indication 
bulb  and  Cone  process  (about  16  times  per  second  versus  about  100  times  per 
second.) 

2.  Software  System 

The  software  for  the  display  programs  has  been  written  in  assembly  language 
to  maximise  the  signal  processing  and  display  formatting  rate.  This  has  been  an 
effective  approach  since  the  processing  and  formatting  are  logically  and  mathe> 
;natically  simple.  Typically,  Che  symbolic  language  version  of  a program  takes 
10>15K  bytes  to  store,  and  the  machine  language  version  1>2K  bytes. 

The  programs  have  been  written  in  a structured  subroutine  format.  The  top 
level  is  a sequence  of  calls  to  subroutines.  The  first  calls  are  to  routines 
which  initialise  constants  and  set  up  the  displays.  These  are  followed  by  the 
main  program  loop  which  calls  routines < to  see  if  the  display  program  should  be 
exited,  change  parameters  based  on  switch  or  keyboard  Inputs,  input  data, 
calibration  of  data,  perform  logic  tests,  format  the  data  for  the  displays,  etc. 
Each  of  these  subroutines  is  a complete  logical  entity,  so  that  new  functions 
n»y  be  added  by  simply  inserting  new  calls.  A similar  approach  has  been  taken 
for  the  lower  levels  of  subroutines.  The  program  data  structures  have  be^n 
designed  so  that  they  allow  an  EPRCM  version  of  the  programs.  Thus  to  perform 
teste  only  a small  fraction  of  the  computer  system  is  needed.  Further  the  opera- 
tion of  the  system  for  demonstrations  is  simplified. 

The  program  for  displaying  proximity  sensor  data  from  the  sensors  on  the 
JFl/CURV  arm  and  performing  event  logic  is  typical  of  the  display  computer  pro- 
grams. The  first  level  structure  is  sho%im  in  part  A of  Fig.  15.  The  actual 
process  for  getting  the  data,  processing  and  displaying  it  are  shown  in  part  B 
of  Fig.  IS.  The  modularity  of  the  structure  was  a significant  help  in  adding 
the  event  logic  and  display  to  the  prior  programs.  All  that  was  necessary  was 
to  add  the  two  blocks  which  perform  the  event  logic  tests  and  which  time  and 
display  Che  event  blinker.  Likewise,  when  changing  the  JFL/Ames  arm  proximity 
sensor  program  to  accept  data  from  the  JPL/CURV  arm  proximity  sensors  all  that 
was  necessary  was  to  change  the  "Read  Sensor  Data"  subrout't  te.  The  subroutines, 
incidentally,  were  taken  from  a previous  force-torque  sensor  program. 
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Y 


EQUAL  LENGTH  (Y  ) OF  TWO  BEAMS 
(D,  AND  D2>  can  be  AN  "EVENT" 


EQUAL  MAGNITUDE  OF  TWO 
ORTHOGONAL  FORCE  COMPONENTS 
CAN  BE  AN  "EVENT" 


Figure  1.  Examples  for  Event  Definition 


Figure  2.  General  Graphics  Display  of  Proximity  Sensor  Beams 
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= RANGE  MEASURED  BY  SENSOR  •'  i \ i = 1, 2,3,4 

D = DISTANCE  \ 

} PRESET  PARAMETERS 
T = TOLERANCE  ) 

LOGIC  DEFINITIONS  FOR  EVENT  E|‘  = |k| 

Ej  =0FORK>0:  EVENT  ISN'T  THERE,  BLINKER  "OFF" 

= I FORK<0:  EVENT  OCCURED,  BLINKER  "ON" 


EVENTS 


1.  YAW  ALIGNMENT  AT 
"D"  WITH  "T"  TOLERANCE 

2.  YAW  ALIGNMENT  ONLY 
WITH'T"  TOLERANCE 

3.  ROLL  ALIGNMENT  AT 
"D"  WITH  "T"  TOLERANCE 


LOGIC  EQUATIONS 

E^  = {|S^-D|-T>0  HIS2“D|-T>0} 
Eg  =1 IS3  - Dl  - T>0  H IS4  - D|  - T>0\ 


4.  ROLL  ALIGNMENT  ONLY 
WITH  "T"  TOLERANCE 


E4  = |IS3-S4|-T>0| 


Figure  3.  Proximity  Sensing  Events  Example 
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POOR  QUauiy 


C D 

Figure  4.  Proximity  Sensing  Events  Graphics  Display 


321 


ANALOG  SIGNALS 

SENSOR  1 
SENSOR  2 
SENSOR  3 
SENSOR  4 

LOGIC  LEVEL 

SENSOR  1 
SENSOR  2 
SENSOR  3 
SENSOR  4 


;L_n 

!L_n 

jL_n 

;L_n 


SUCCESS:  EACH  OF  THE  FOUR  SENSORS  OUTPUT  IS  IN  LOGIC  STATE  'T' 

(THEN  TONE  AND/OR  GREEN  LIGHT  ARE  AUTOMATICALLY  TURNED 
ON  INDICATING  TO  OPERATOR  THAT  DEPTH  POSITION  AND  PITCH 
AND  YAW  ALIGNMENTS  OF  END  EFFECTOR  ARE  OK  FOR  SUCCESSFUL 
GRASP  OF  TARGET) 


Figure  6.  Analog  "Event  Logic"  Indicating  Acceptable  Combinations  of  Range, 
Pitch  and  Yaw  Errors  for  Successful  Grasp  Using  Four  Proximity 
Sensors  Integrated  with  JSC  Four-Claw  End  Effector 
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- MEASUREA€NTS  - 


H » RANGE 

SENSOR \\  \ OR  DEPTH 

DISTANCE \ 

7777777777777^^^^777777^^777777^7777777 


- SUCCESS  LOGIC  - 


WHERE  H = 1/2  (Dj  + D3) 
1/2  (Dj  + D^) 

(2)  (D, -d/  + (D2-d/<L 

WHERE  L = = [f(H)]^ 

IF  BOTH  CONDITIONS  ARE  TRUE 
THEN  LIGHT/BUZZER  ARE  ON, 
OTHERWISE  OFF 


Ha,  Hg,  H^,  HpANDK 

(AND  IMPLICITLY  ALSO  C*) 
ARE  PRESET  CONTANTS 


f(H)  IS  GIVEN  BY  THE 
TRAPEZOID  FORMULA 
SHOWN  ABOVE 


Figure  7.  Conic  Algorithm  Indicating  Acceptable  Combinations  of  Range,  Pitch 
and  Yaw  Errors  for  Successful  Grasp  Using  Four  Proximity  Sensors 
Integrated  with  JSC  Four**Claw  End  Effector 


324 


ORIGINAL  PAGE  IS 
OF  POOR  QUALITY 


Figure  8.  Test  Scenes  at  the  JSC  Manipulator  Development  Facility  Using  Four 
Proximity  Sensors  integrated  with  JSC  Four-Claw  End  Effector  and 
Simple  "Go-No  Go"  Event  Display 
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COLOH  GRAPHICS  FORMAT 


N> 

ON 


Figure  9*  Graphics  Display  Concept  Indicating  Both  Success  and  Details  of  Error  States 


ORIGINAL  PAGE  IS 
OP  POOR  QUALITY 


X fx 


TRANSFORMATION  MATRIX 
UNDER  IDEAL  CONDITIONS 


FORCES 
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Figure  10*  Force-Torque  Sensor  Measurement  Transformation 
and  Graphics  Display 
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A.  FORCE  CONTROL  TASK: 


T-TOLIRANCE 


B.  FORCE  SENSOR  TASK  DISPLAYS: 


Figure  11.  Force-Torque  Sensing  Event  Example 
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SENSING  CONCEPT  AND  MEASUREMENT  PRINCIPLE 
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Figure  12.  Multipoint  Proportional  Touch  Sensors  with  Numeric 
and  Color  Graphics  Displays 
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EVENT: 


DISPLAY 
FORMAT  OF 
4x8  » 32 
SENSITIVE 
CELLS: 


IF  NO.  OF  SENSITIVE  SC  < 16  16<  SC<  24  SC  ^24 

CELLS  (SC)  UNDER 
PRESSURE  IS; 


THEN  COLOR  IS:  RED  YELLOW  GREEN 


(NB:  THE  SHADED  CELLS  ARE  THOSE  UNDER  PRESSURE. 
THEY  HAVE  TONES  IN  THE  RESPECTIVE  COLORS 
DARKER  THAN  THE  UNSHADED  CELLS.) 


Figure  13.  Touch  Sensing  Event  Example 


INCREASE  OF  CONTACT  AREA 


m'm\ 
mwm 


vmM 
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Figure  14.  Computer  System  for  Sensor  Data  Graphics  Displays 
in  the  JPL  Teleoperator  Project 


331 


A.  OVERALL  PROGRAM  STRUCTURE 


B.  GET  DATA  AND  DISPLAY  FUNCTIONS 


Figure  IS,  Software  Syatem  Structure 'for  Proximity  Sensor  Date  Graphics 
Display  in  the  JPL  Teleoperator  Project 
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INTRODUCTION 

SIMPAC  is  a general-purpose 
real-time  simulation  facility 
currently  configured  with  an 
Orbiter-like  Crew  Compartment 
and  a Displays  & Controls  (D&C) 
Subsystem  to  support  the 
engineering  development  of  the 
Space  Shuttle  Remote 
Manipulator  (SRMS). 

The  simulation  consists  of  a 
software  model  of  the 
anthropomorphic  SRMS 
manipulator  arm  including  the 
characteristics  of  its  control 
system  and  joint  drive  modules. 
Structural  flexibility  is 
modelled  by  presenting  the 
principal  modes  in  six  degrees 
of  freedom. 

The  SRMS  control  system  is 
normally  operated  in  a Resolved 
Motion  Rate  Common  moder 
commonly  known  as  the  Manual 
Augmented  or  simply  Manual 
mode.  The  point  of  resolution 
if  just  inside  the  tip  of  the 
End  Effector  of  the  arm,  where 
the  head  of  the  Payload  Grapple 
Fixture  would  fall  when  in  the 
nominal  position  for  legal 
capture.  A Single  mode  is  also 
available  for  selection^ 
whereby  the  Operator 
individually  commands  each 
joint  in  turn.  In  both  of 
these  modes  a Coarse/Vernier 
range  may  be  selected^  and  Rate 
Hold  function  may  be  applied  in 
the  Manual  mode. 

Four  coordinate  systems  may  be 
selected  which  define  the  point 
of  resolution  and  the  spatial 
system  response  to  hand 
controller  inputs.  The 
principal  reason  for  this  is  to 


enable  the  Operator  to  move  the 
End  Effector  (and  the  Payload 
when  attached)  in  the  most 
direct  way  possible  and  reduce 
the  amount  of  mental 
transformation  required. 

Automatic  sequences  are 
available  to  manoeuvre  the  arm 
between  fixed  points.  A 
terminal  position  and  attitude 
may  be  determined  by 
pre-programming  or  by  detailed 
Operator  input  via  a keyboard. 
The  system  will  move  in  an 
optimized  path  to  the  terminal 
point,  provided  the  initial 
conditions  have  been 
fulfilled. 

SIMULATION  & SCENE  GENERATION 
SUBSYSTEMS' 

A master/slave  computer  pair 
(TI  98 OB),  an  Array  Processor 
and  floating-point  hardware 
complex  execute  all 
computations  under  a 
simulator-oriented  multi-task 
operating  system  (SIMTOS); 
driving  a multi-process 
interface  to  which  all 
displays,  instruments  and  other 
input/output  circuitry  are 
connected.  An  extensive  set  of 
peripherals  perform  data 
gathering  and  software 
development/maintenance  tasks. 

Displays  in  SIMPAC  are  driven 
by  a set  of  three  Varian 
computers  (V73),  an  array 
processor  and  picture 
generation  hardware.  An  Aft 
and  an  Overhead  out-the-window 
scene  are  presented  on  two 
large  CRT  screens  equipped  with 
pancake  windows  to  approximate 
infinity  optics.  Two  smaller 
monitors  simulate  CCTV  scenes 
from  six  possible  camera 
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positions  in  selected  pairs.  Of 
these  the  camera  mounted  on  the 
wrist  of  the  arm  seems  to  carry 
the  greatest  impact  and  will  be 
discussed  in  detail  below. 

The  visual  presentation  is 
driven  by  a serial  data  link 
output  from  the  simulation 
subsystemr  delivered  every  50 
msecr  the  pictures  are 
refreshed  three  times  between 
the  frame  updates.  Camera 
controls  enable  the  Operator  to 
zoom  all  cameras,  and  to  pan 
and  tilt  all  except  the  End 
Effector  (Wrist)  Camera. 

Cockpit  displays  and  controls 
resemble  the  Manipulator 
Station  of  the  Orbiter.  Mode 
selector  switches,  digital 
position/attitude/rate  readouts 
and  a comprehensive  Caution  & 
Warning  annunciator  panel  are 
mechanized  and  driven  by  the 
main  model  outputs. 

A Translational  (THC)  and  a 
Rotational  Hand  Controller 
(RHC)  are  mounted  to  the  left 
and  right  of  the  D&C  panel.  The 
THC  has  one  linear  and  two 
pivoted  axes  in  a package 
representing  the  flight 
article.  It  controls  the  rates 
of  movement  in  the  X,  Y and  z 
freedoms  of  the  point  of 
resolution  in  the  coordinates 
selected.  The  RHC  has  three 
pivoted  axes  and  controls  the 
attitude  (angular)  rates  about 
the  point  of  resolution.  It 
also  carries  the  Rate  Hold, 
Capture/Re lease  and 
Coarse/Vernier  auxiliary 
controls.  The  THC  has 
rate-dependent  damping,  both 
have  spring  return  and  breakout 
forces. 


Caution/Warning  annunciators 
include  a Master  Alarm  coupled 
with  an  audio  tone,  and  a 
lighted  annunciator  panel.  The 
two  most  frequently  activated 
are  the  Reach  Limit  Alarm, 
indicating  that  one  of  the 
joints  is  too  close  to  its 
angular  limit,  and  the 
Singularity  alarm  signalling  a 
limited  arm  geometry  such  as 
that  of  the  arm  at  rest  in  its 
latches,  fully  extended  and 
unable  to  accommodate  an 
applied  load  by  yielding  to 
excessive  forces. 

The  manual  control  problem  can 
be  appreciated  by  considering 
that  the  design  load  limit  of 
the  arm  is  a deflection  of  25.4 
mm  (1.0")  under  a lateral  force 
of  4536  g (10)  lbs,  with  the 
not-to-exceed  limit  being  4763 
g 15  lbs.  Software  stops 
provide  protection  by  refusing 
to  drive  a joint  into  its  hard 
stops  and  arm  movement  ceases 
completely  if  the  Reach  Limit 
alarm  does  not  result  in  the 
reversion  of  the  manual 
inputs. 

THE  SRMS  TASK  IN  SIMFAC 

The  prinQipal  task  of  the  SRMS 
Operator  is  to  manoeuvre  the 
arm  and  its  End  Effector  into  a 
precise  position  and  attitude 
with  respect  to  the  Payload  in 
order  to  establish  a rigid 
contact  with  the  Grapple 
Fixture,  and  thence  manoeuvre 
the  Payload  into  the  desired 
position  and  attitude  with 
respect  to  the  appropriate 
coordinate  references,  with 
zero  residual  energy  remaining 
in  the  total  system.  In  real 
life,  the  End  Effector  must  not 
contact  the  Payload  until  the 
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latter  has  been  secured  against 
escape,  and  must  not  touch  any 
other  part  except  the  grapple 
fixture.  The  Payload  may 
initially  be  moving  with 
respect  to  the  Orbiter  or  it 
may  be  docked  and  secured  in 
the  Cargo  Bay  of  the  Orbiter. 
Relative  velocity  in  excess  of 
0.061  m/s  (0.2  fps)  constitutes 
an  illegal  capture  condition 
where  contact  must  not  be 
attempted.  The  arm  must  arrest 
the  Payload  within  608  mm  (2.0 
feet)  after  Capture.  The 
positioning  accuracy  must  be 
such  that  the  maximum  size 
Payload  18.24m  long,  4.56  m dia 
(or  60  feet  long  x 15  feet 
diameter)  ban  be  placed  into 
the  Cargo  Bay  with  an 
all-around  clearance  of  76.2  mm 
(3.0  ins). 

In  the  case  of  the  simulated 
moving  Payload,  the  Operator 
must  establish  stable  tracking 
with  the  End  Effector  before 
attempting  to  grapple,  in 
approx.  80  secs,  from  the  time 
the  Payload  enters  the 
effective  reach  envelope  of  the 
arm.  This  phase  is  the  most 
dynamic  of  the  entire  control 
task  and  will  be  the  principal 
subiect  of  discussion  from  here 
on.  The  tracking  and  eventual 
capture  are  based  almost 
exclusively  on  the  visual 
information  provided  by  the 
CCTV  camera  carried  by  the  arm. 
This  scene  is  presented  on  a 
small  CCTV  monitor  to  the  right 
of  the  Operator  with  a reticule 
applied  to  the  glass  envelope. 
This  "gunsight"  scene  has  a 
significant  impact  on  the 
Operator;  any  high  rate  of 
movement  or  oscillatory 
behaviour  generates  a high  gain 
condition  in  the  external 


man-machine  loop,  increases  the 
workload  and  may  lead  to  PIO 
(Operation-Induced 
Oscillations).  Among  other 
things,  it  encourages  capture 
attempts  "on  risk",  i.e. 
without  the  assurance  of  being 
within  legal  limits.  Since  the 
camera  is  simulated  as  mounted 
on  the  wrist,  a less  than 
stable  platform,  arm 
flexibility  effects  generate 
just  such  visual  dynamics,  in 
addition  to  those  produced  by 
the  real  movement  of  the 
Payload  with  respect  to  the  End 
Effector.  Furthermore,  the 
Operator  is  not  positioned  on 
the  same  platform,  hence  he 
will  not  receive  motion  cues  to 
help  him  compensate  for  the 
lively  visual  scene. 

A less  dynamic  but  equally 
difficult  situation  ensues  when 
the  principal  axes  of  the 
Payload  or  the  End  Effector  are 
displaced  from  being  parallel 
to  those  of  the  Orbiter.  The 
four  available  coordinate 
systems  recognized  by  the 
control  algorithm  are 
referenced  to  the  End  Effector, 
the  Orbiter,  and  the  Payload, 
respectively,  and  the  fourth  is 
divided  between  the  Payload  for 
attitudes  and  the  Orbiter  for 
translations.  Euler  sequences 
destroy  the  spatial 
correspondence  between  the  hand 
controllers  and  system  response 
where  the  coordinate  system  in 
use  moves  with  the  Payload  or 
End  Effector,  but  the  Operator 
remains  "frozen"  to  the 
Orbiter.  Furthermore,  a 
coordinate  system,  consistent 
in  the  engineering  sense,  will 
generate  contradictory  display 
increments  and  cause  wrong-sign 
inputs  unless  its  sign 
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convention  is  duly  adjusted  to 
conform  with  the  aeronautical 
"positive"  and  "negative"  in 
terms  of  switch  or  stick 
movements. 

In  summary,  the  SRMS  command 
task  is  somewhat  similar  to 
flying  a airplane  by  remote 
control,  rather  than  that  of 
piloting  an  aircraft. 

OPERATOR  TACTICS  AND  OPTIONS 

Successful  Operators  in  the 
SIMPAC  simulations  have  quickly 
learned  to  accommodate  the 
basic  system  responses  and 
developed  individual  but 
similar  command  techniques.  In 
the  capture  task  they  eliminate 
attitude  errors  first,  in 
Coarse  mode  at  a safe  distance 
from  the  Payload,  then  use 
long,  smooth  approaches, 
maintain  tracking.  They  apply 
ramped,  well-damped  command 
inputs  to  avoid  flexibility 
effects  and  to  reduce  the  image 
displacement  rate  on  the  End 
Effector  gunsight  scene.  One 
attitude  and  one  translational 
correction  is  applied  as  a pair 
to  avoid  roll-pitch 
cross-coupling  and  to  minimize 
target  displacement  on  the  CCTV 
scene.  Trained  Operators 
maintain  a good  inner  image  of 
the  arm  geometry  and  are  able 
to  avoid  joint  angle  limits, 
estimate  the  total  arm 
performance  available  and  even 
trade-off  rotational  vs. 
translational  corrections  for  a 
smooth  and  efficient  approach. 
The  SIMPAC  hahd  controller 
characteristics  are  said  to 
make  a significant  difference 
against  earlier  models  which 
had  no  damping  and  generally 
poor  engineering  quality. 


Operator  options  such  as 
Vernier  selection  which  reduces 
the  command  authority  to  10%, 
and  Rate  Hold,  are  used  by  all 
Operators,  the  former  mostly  to 
reduce  the  liveliness  of  the 
gunsight  scene  and  to  increase 
precision  as  required.  The 
system  applies  Vernier 
automatically  on  Capture,  i.e. 
during  the  transition  between 
unloaded  and  loaded  arm,  and  a 
manual  selection  reduces  the 
Loaded  Vernier  velocity  to 
50%. 

WORKLOAD 

A peak  is  reached  during  the 
Track  and  Capture  task.  Arm 
flexibility  effects  appear  in 
the  CCTV  reticule  as  elliptical 
oscillations,  easily  excited 
with  high  visual  effects 
especially  at  close  range. 
However,  they  damp  out  if  not 
further  excited  and  true  PIO 
does  not  develop.  The  spare 
Operator  capacity  is 
significantly  reduced,  the 
gunsight  scene  is  the  focus  of 
intense  concentration.  The 
selection  of  Vernier  is  easily 
predictable  for  most  Operators, 
as  a function  of  range  from  the 
Grapple  Pixture,  since  it  is 
determined  by  their  acceptance 
of  activity  on  the  CCTV  scene. 

Other  sources  of  increased 
workload  include  the  necessity 
to  make  ramped  inputs  to 
command  precision  movements,  to 
perform  mental  transformations 
in  Payload  manoeuvering  and  the 
management  of  the  DsC 
subsystem,  especially  while 
operating  in  the  Single  mode, 
controlling  each  joint 
individually.  Ramped  inputs 
require  high  concentration  over 
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many  seconds;  well-balanced  and 
damped  hand  controller 
characteristics  are  essential. 
Coordinate  transformations  also 
require  high  mental  effort 
during  the  final  phases  of 
Payload  positioning^  since  a 
wrong-sign  input  will  not  only 
disturb  a near-perfect 
deployment  condition,  but  many 
cause  collisions  during  the 
berthing  task,  with  the  Payload 
in  close  proximity  with  the 
Orbiter, 

Displays  and  Controls 
Management  involves  mode 
selection  and  display 
selection,  since  all  parameters 
cannot  be  simultaneously 
displayed;  XVZ  position  and 
pitch-yaw-roll  attitude  must  be 
selected  for  digital  display 
readout.  Mode  selection  must  be 
followed  by  an  Enter  command  to 
be  accepted  by  the  system.  The 
Single  mode  involves  not  only 
display  selection  (associated 
with  the  tasks  the  mode  is 
normally  used)  but  also  the 
selection  of  each  of  the  six 
joints  followed  by  the 
operation  of  a double-throw 
switch  for  positive  or  negative 
input. 

In  summary,  the  Resolved-Motion 
Rate  Control  system  provides 
adequate  means  to  control  the 
manipulator  arm  by  one  Operator 
as  specified  for  the  SRMS 
tasks.  Research  work  at  MIT, 
NASA/ JSC,  NASA/Ames  and 
NASA/Nar shall  have  been 
compared  with  some  experimental 
setups  at  Martin-Marietta,  as 
well  as  Honeywell  and  CAE 
experience  in  fly-by-wire 
applications,  and  command 
philosophies  such  as  the 
replica  arm  and  force-stick 


controllers  have  been 
considered  but  later  rejected 
in  favour  of  the  displacement 
stick  and  rate  command  with 
resolved-motion  augmentation. 

A six  degree-of- freedom 
controller  would  have  been 
favoured  for  a 

single/command/input  point  but 
had  to  be  abandoned  for  lack  of 
cockpit  space  and  because  of 
higher  design  risk. 

OPERATOR  ERRORS  AND  SOURCES 

Up  to  the  time  of  this  writing, 
the  main  SIMPAC  effort  was 
directed  to  validate  the 
flexible  arm  and  SRMS 
subsystems  simulation,  and  to 
establish  basic  controllability 
and  operability  for  the  tasks 
specified.  Initial  work  has 
been  completed  to  simulate 
malfunctions  and  off-nominal 
conditions  to  verify  procedures 
and  indicate  parameter 
sensitivities.  No  attempts 
have  been  made  to  simulate 
side-tasks,  Orbiter  environment 
and  on-orbit  workload.  However, 
comments  of  Operators  have  been 
carefully  recorded  and 
analyzed,  and  their  assessment 
of  their  own  performance  was 
elicited  whenever  practicable, 
both  in  terms  of  the  simulation 
and  the  simulated  SRMS  tasks. 

Short  of  malfunctions,  the 
reference  coordinate  systems 
and  sign  conventions  presented 
the  greatest  single  problem  as 
soon  as  human  operators  were 
inserted  in  the  control  loop. 

The  End-Effector  CCTV  scene 
with  its  reticule  is 
essentially  a fly-to  display. 
One  of  the  Alignment  Aids 
(Payload  target)  resembled  the 
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small  aircraft  symbol  usually 
found  on  artificial  horizons 
and  flight  directors.  An 
Operator  with  long  flying 
experience  promptly  reverted  to 
the  fly-from  technique 
associated  with  that  type  of 
instruments  and  has  had 
considerable  trouble  in 
readjusting  his  thinking  during 
the  demanding  Track  and  Capture 
task.  With  a different  target 
he  had  no  difficulty. 

Arm  geometry  causes  non-linear 
responses  due  to  limitations  in 
the  individual  joint  drives, 
necessary  to  ensure  that  the 
End  Effector  does  not  exceed 
certain  velocity  limits.  Finite 
joint  ranges  and  arm 
singularities  also  cause 
uncommanded  stoppages.  While 
most  of  these  effects  can  be 
avoided  or  accommodated  by 
trained  Operators,  the  visual 
conditions  in  SIMFAC  do  not 
provide  texture,  hardware 
markings,  shadows  and  other 
assistive  side  effects. 

Visual  conditions  in  the  Space 
Shuttle  are  expected  to  vary 
between  extremes,  from 
sunshafting  and  specular 
reflections  to  near-total 
darkness.  Wide  variations  in 
illumination  will  occur  with 
every  adjustment  of  the  Orbiter 
attitude  or  Payload  position. 
Judgement  of  depth  or  X-ranging 
is  expected  to  be  poor  in  real 
life  as  it  is  in  SIMFAC,  with 
its  two-dimensional  visual 
displays. 

The  dynamic  aspects  of  the 
SIMFAC  visual  presentation  are 
quite  adequate.  However,  the 
SRMS  task  itself  produces 
low-key  visual  cues  with  low 


dynamics,  difficult  to  detect 
and  monitor.  A 18.24m  (60  ft.) 
long  Payload  suspended  say 
15.2m  (50  ft.)  away  from  the 
Operator  may  have  a very  low 
yaw  rate  but  its  end  bulkheads 
move  with  relatively  high 
speed,  and  may  contain  great 
energy  with  the  maximum  Payload 
mass  of  29,484  Kg  (65,000  lbs). 
Furthermore,  arm  flexibility 
effects  and  control  system 
responses  are  very  similar  in 
their  visual  aspects  under 
certain  circumstances  near  the 
Cargo  Bay,  potentially  inducing 
the  Operator  into  erroneous 
corrective  action. 

The  SIMFAC  Displays  and 
Controls  Subsystem  resembles 
the  Orbiter  complement  but  is 
not  completely  representative 
of  it  and  lacks  some  of  the 
visual  impact  of  the  flight 
article.  The  hand  controllers 
are  engineering  model  quality 
but  well  engineered  and  have 
acceptable  force 
characteristics  and  feel. 

The  harmony  of  manual  input  to 
system  response  is  generally 
good,  the  controllers  providing 
a one-to-one  relationship  with 
the  desired  Payload  or  End 
Effector  movement.  The 
displays  follow  the  system 
responses  adequately  and 
present  necessary  and  useful 
task  information.  However,  the 
harmony  between  the  command 
inputs  and  the  display 
responses  is  not  optimized  in 
that  the  position  and  attitude 
information  is  referred  to  the 
Orbiter,  while  the  command  axes 
may  be  transferred  to  the  End 
Effector  or  Payload.  Hence, 
the  same  manual  input  will 
drive  one  display  window  or 
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another,  depending  on  the  Euler 
angles.  The  Operator  then  has 
to  compensate  with  mental 
transformations  and  therefore 
is  prone  to  errors  and 
incorrect  inputs.  This  effect 
is  most  noticeable  in  precision 
manoeuvres  during  Berthing  and 
Payload  Deployment,  when  the 
Operator  is  “flying  the  Payload 
on  instruments",  i.e.  making 
final  adjustments  by  the 
digital  displays.  This 
observation  on  SIHFAC  resulted 
in  a change  of  SRHS  coordinate 
systems  and  displayed  values. 

The  management  of  displays  and 
controls  is  a significant  side 
task  with  some  peak  workloads 
occurring  in  parallel  with 
other  high-activity  periods. 

AREAS  FOR  FURTHER  WORK 

Visual  improvements  are  being 
planned  for  SINFAC.  Full 
hidden  line  removal  and 
additional  scene  contents  are 
considered.  As  noted  above, 
the  dynamics  of  the  visual 
scenes  are  largely  satisfactory 
and  carry  a high  impact. 

Orbiter-SRMS  interaction, 
namely  reactive  forces  and  the 
operation  of  the  Orbiter 
attitude  control  systems,  have 
not  been  fully  simulated  in 
SINFAC. 

Man-machine  integration  and 
rigorous  Operator  modelling 
work  would  be  most  desirable 
from  the  resarch  point  of  view, 
since  these  are  outside  the 
scope  of  an  industrial 
development.  Multi-axis  hand 
controllers,  computer-driven 
active  force  feel  systems, 
integrated  displays  may  be 


needed  for  future  generations 
of  Remote  Manipulators.  The 
loop  dynamics  exhibited  by  the 
wrist  camera  in  this  simulation 
in  connection  with  the  human 
visual  and  neuromotor  channels 
is  peculiar  to  large 
manipulators  and  presents  a set 
of  interesting  modelling  tasks 
in  itself. 

GENERAL  OBSERVATIONS 

The  simulation  as  a whole  is 
considered  successful,  judging 
from  the  reaction  of  Operators 
to  computer  glitches  and 
malfunctions.  These  indicate 
that  the  experienced  Operator 
is  very  much  in  the  simulation 
picture  and  is  using  his  best 
efforts  to  perform  the  task. 

Learning  curve  effects  are 
readily  visible  and  repeatable, 
well  documented.  The  task 
presented  in  SIMFAC,  that  of 
capturing  a free-flying 
satellite  and  berthing  it  into 
the  Cargo  Bay  is  deemed 
equivalent  to  the  worst  case 
task  expected  to  be  attempted 
in  real  life. 

Quick  setup  and  initialization 
capability  of  SINFAC  facilities 
manned  simulation  under 
reasonably  consistent 
conditions. 

The  observed  command  strategy 
and  Operator  behaviour,  as  well 
as  individual  performances, 
clearly  indicate  not  only  the 
existence  of  an  "inner  model" 
but  the  necessity  of  one  even 
in  the  static  sense,  whereby 
some  (^rators  manage  to 
maintain  a picture  of  arm 
configuration  regardless  of  arm 
visibility,  and  avoid  potential 
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joint  limits,  singularities  and 
collisions. 

Some  Operators  perform  equally 
well  in  dynamic  and  precision 
manoeuvres,  others  exhibit  a 
distinct  preference  and  success 
in  one  or  the  other.  No 
explanation  is  offered  at  this 
time  except  the  possibility 
that  the  force  characteristics 
of  the  hand  controllers  may 
have  enhanced  competence  in 
some  cases  by  matching  the 
individual  neuromotor  systems. 

The  flexibility  of  the  dynamic 
arm  presented  a distinct 
increase  of  task  difficulty 
compared  to  the  kinematic  arm 
model,  but  all  operators 
managed  to  adapt  their  input 
rates  and  control  strategies  to 
overcome  these  effects.  It  may 
be  noted  that  both  the 
increased  dynamics  in  the  wrist 
camera  scene  due  to 
flexibility,  and  the  absence  of 
an  alignment  aid  target,  led  to 
attempts  to  capture  with  less 
than  proper  alignment  or  at  a 
questionable  capture  distance. 

Simulated  malfunctions 
presented  in  SIMPAC  generated 
three  distinct  phases  of 
response  in  each  Operator 
participating  in  the  tests.  At 
first,  a malfunction  was 
immediately  considered  on  the 
SIMPAC  system,  i.e.  a 
simulation  error.  No  corrective 
action  was  attempted.  In  the 
next  phase,  most  Operators 
blamed  themselves,  claimed  Crew 
Error  and  tried  to  rectify  it 
until  they  realized  that  the 
corrective  commands  were 
ineffective.  Finally, 
absolutely  everything  out  of 
line  was  suspect,  and 


immediately  questioned  as  to 
which  malfunction  is  being 
presented. 

Prom  the  point  of  view  of 
man~machine  integration,  the 
external  loop  composed  of  the 
Operator,  the  Wrist  Camera 
display  and  the  behaviour  of 
the  End  Effector  due  to 
flexibility  effects  and  arm 
geometry  present  a intricate 
problem.  It  is  impossible  to 
analyze  these  relationships  on 
paper  and  understand  the  wide 
range  of  factors  involved,  many 
of  which  are  intangible,  such 
as  the  aeronautical  control 
conventions  ingrained  in 
Operators  with  piloting 
experience.  SIMPAC  has  some 
shortcomings?  to  be  sure?  the 
visual  scenes  lack  texture, 
reflections  and  shadows, 
contrast  and  similar  effects, 
but  the  dynamics  of  the 
presentation  are  sufficiently 
convincing  to  point  out  flaws 
in  the  man-machine  interface 
and  to  validate  system 
stability  and  operability  with 
man  in  the  loop. 
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Abstract 

This  paper  discussea  the  potential  of  supervisory  controlled  tele- 
operators for  accoaplishaant  of  nanipulation  and  sensory  tasks  in  deep 
ocean  environments*  and  discusses  one  such  system.  Teleoperators  and 
svq>ervisory  control  ace  defined*  the  current  pcdDlems  of  hman  divers  ace 
reviewed*  and  some  assertions  are  made  about  why  supervisory  control  has 
potential  use  to  replace  and  extend  human  diver  capabilities.  The  relative 
roles  of  man  and  computer  and  the  variables  Involv^  in  man-computer  inter- 
action are  next  discussed.  Finally*  a detailed  description  of  a supervisory 
controlled  tele<^rator  system*  SUPERMAN*  is  presented. 


1.  Teleenerators  and  Supervisory  Control 

Many  future  undersea  tasks  may  be  aeeoi|>llahed  by  "teleoperators". 

We  define  teleoperators  to  be  general  purpose  submersible  work  vehicles 
controlled  remotely  by  hummn  operators  and  %flth  video  and/or  other  sansorst 
power  and  propulsive  actuators  for  mobility*  with  mechanical  hands  and  arms 
for  manipulation  and  possibly  a computer  for  a limited  degree  of  control 
autonomy.  A manned  submersible  is  not  a teleoperator  vehicle,  but  its 
attached  manipulators  are  certainly  teleoperators,  requiring  control  through 
a viewing  port  or  through  closed-circuit  video.  Sometimes  the  term  "tele- 
operator" is  restricted  to  telemanipulator,  excluding  the  system  for  re- 
motely positioning  and  orienting  a sensor,  but  for  the  sake  of  generality 
we  Include  this  important  function. 

This  paper  focuses  on  those  aspects  of  undersea  teleoperation  %ihi^ 
concern  the  human  operator  and  the  man-machine  Interface,  and  within  this 
still  relatively  broad  domain,  it  concentrates  on  the  prospects  for  utili- 
sation of  "supervisory  control".  Supervisory  control  is  a hierarchical 
control  scheme  thereby  a system  (which  could  be  a teleoperator,  but  could 
also  be  an  aircraft,  power  plant,  etc.)  having  sensors,  actuators  and  a 
computer,  and  capable  of  autonomous  decision' making  and  control  over  Short 
periods  and  in  restricted  conditions,  is  remotely  monitored  and  inter- 
mittently operated  directly  or  reprogramaed  by  a person. 

The  distinction  between  direct  honmn  control  of  a teleoperator  and 
supervisory  control  of  a teleoperator  is  made  graphically  in  Figure  1.  Xn 


* This  work  was  supported  by  Office  of  Naval  Research  (Contract  N00014-77<C-02S€) 
and  by  the  MZT  Office  of  Sea  Grant  (National  Oceanographic  and  Atmospheric 
Administration). 
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Figure  1*  DellniCtonc  of  Teleoperecor  end  Supervisory  Control 


Definttione 

TELEOPERATOR 


;**S!WL  page  is 
«x»  guALUT 


A vehicle  hevlitg  eeneore  end  eetuatore  for  nobllUy  nnd/or  mnlpulntion 
controlled  by  e h«mnn  operator,  and  thua  cnabllnR  him  to  extend  hlhaelf  to 
physically  ranote  or  hasardoua  envlronnenca. 


SUPERVISORY  CONTROL 

A helrsrehical  control  achene  vherehy  a device  having  aensora,  actuatora 
and  a conputar,  and  capabla  of  autononoua  decision  iMhlng  and  control  over  abort 
perioda  and  raatrictad  condltiona  la  rMOtely  nonitored  and  Intetviittantly  operate 
directly  or  rapragraiwul  by  a parson. 
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the  iqpper  figure  the  htMen  diceetly  controU,  over  eitlier  a wire  or  sonic 
eoMMunleatlon  linkf  the  separate  propulsive  actuators  of  the  vehicle,  the 
actuators  for  the  separate  degrees  of  freedooi  of  the  mnlpulator,  and  the 
pan  and  tilt  actuators  of  the  video  caiwra*  the  video  picture  is  sent 
bacte  directly  to  the  operator*  The  "hand  control"  can  he  a aaster-slave 
positioning  replica  or  a rate  jcysticic* 

In  the  loner  figure  a cosiputer  is  added  to  the  teleoperator,  and  for 
short  periods  and  lladted  circunstances  this  teleoperator  aay  function 
autononously* 

At  the  hottoM  are  generic  definitions  of  teleoperator  and  snqpervlsory 
control*  The  upper  drawing  portrays  the  fociser  without  the  latter*  n«e 
lower  drawing  is  the  coiMLnation* 

In  supervisory  control  the  teleoperator's  <re«ote)  conputer  cosnunie 
cates  at  high  bit*rate  with  the  teleoperator^s  sensors  and  actuators*  But 
because  of  bandwidth  constraints  on  the  signal  tranaaission  link,  or  be- 
cause of  teleoperator  sensing  llaiitations,  cosassiication  aay  be  restricted 
to  low-bit-rate  with  the  huaan  operator's  (loeal)  coaputer*  Vor  this  reason, 
and  also  because  of  the  interalttent  nature  of  huaan  aonitoring  and  repro- 
graiasing  of  coaaands  on  a keyboard  (and  possibly  joystick  or  other  controls), 
the  huaan  supervisor's  coaaunication  with  the  teleoperator  tends  to  be  at  a 
slow  rate,  i*e*,  toteraittent  sysbol  strings  or  aoveasnt  sequMKtes  on  a 
aaster-controller  tfito  relatively  aany  bits  per  instruction  package*  His 
coaaunication  t«ith  the  local  coi|iuter  to  refre^  TV  laages  or  to  edit  or 
"dry  run"  his  coaaands  on  a aodel  before  eoaaitting  thea  to  action  aay  be 
constrained  only  by  his  own  speed  liaitations* 

The  physical  separation  of  local  and  reaote  coaputer  is  not  necessary 
in  aircraft,  in^trlal  plants  or  other  systeas  idiere  the  operator  is 
physically  nearby,  and  where  supervisory  control  is  used  for  reasons  other 
than  physical  rsaotoness  md  Halted  ecaaunieation  channel  capacity  be- 
tween huaan  operator  and  the  object  of  control*  In  such  situations  super- 
visory control  aay  be  advantageous,  nevertoeless,  to  a^eve  faster  or  aore 
accurate  control,  or  to  control  siaultaneously  in  aore  degrees-of-freedaa 
than  the  operate  can  a^eve  by  direct  servo-control,  <mt  to  relieve  hia 
of  tedlua*  The  latter  reasons  for  supervisory  control  can  apply  to  ur^r- 
sea  vehicles  tdwin  the  huaan  operator  is  not  physically  distant  (as  with 
aamed  subaersibles)  or  to  undersea  teleoperators  when  a reliable  high- 
bandwidth  coaaunication  channel  (wire  or  optical  tether)  is  available* 


2*  Wiv  Teleoporetors  Underseas?  The  Malts  of  Piyers  and  Wanned  Bubasrsibles* 
The  principal  reasons  fot  Inteimt  in  using  teleoperators  for  underseas 
tasks  are  dollar  costs  and  safety- 


operations,  including  exploration,  inspection,  construction,  aaintenance, 
salvage  and  rescue,  are  having  to  be  perforsad  at  increasing  depths*  At 
suoh  depths  - below,  say  300a*  (depending  upon  the  paticular  task)  the  tise 
required  for  divers  • Mostly  ceapresaion/decospression  tiaw  - becosas  ex- 
cessive; factors  having  to  do  with  depth  par  so,  including  life  support  egu;^ 
asnttbecone  increasingly  costly;  perstwMl  safety  is  aare  and  note  dUFfieult 
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to  maintain.  These  assertions  are  borne  out  by  rather  alarming  mortality 
figures  for  comoercial  divers  in  the  North  Sea. 

Water  turbidity  and  other  depth-related  factors  may  require  greater 
bottom-time,  thus  con|>otinding  the  decompression-time  factor.  Under  such 
conditions,  a fixed-capability  teleoperator*%diich  sometimes  is  seen  as  too 
cliansy  by  compari8<m  to  e hximan  diver  at  shallower  depths,  becomes  much 
more  attractive  economically. 

Happily,  there  is  progress  in  the  development  of  teleoperators,  and 
they  are  becoming  less  clumsy.  Inspection  and  manipulation  tasks  which 
sisply  could  not  be  acconpllshed  a few  years  ago  are  now  achievable,  due 
to  steady  progress  in  the  design  of  video  systems,  mechanical  valves  and 
actiiators,  etc.  For  the  inmediate  future,  however,  the  primary  technolog- 
ical factor  which  is  changing  the  prospects  for  undersea  telegperation  is 
the  conputer. 

Circa  1970  divers  seemed  to  have  the  edge  on  manned  work-vehicles  with 
manipulators  in  terms  of  maneuverability,  manipulation,  tactile  sensing, 
and  covertness.  Because  of  smaller  tmmanned  vehicles  and  eventually  through 
unmanned  untetl.ered  vehicles,  however,  the  diver  (especially  the  tethered 
diver)  is  losing  his  edge.  Manipulation,  sensing  and  cognition  remain  the 
primary  advantages  for  the  diver,  but  the  conputer  is  changing  these  also. 

The  conparlson  between  teleoperators  and  manned  submerslbles  is  more 
clear-cut.  The  fact  is  that  television  cameras  can  now  "see"  with  less 
light  than  the  hionan  eye,  and  new  sonic  imaging  systems  can  see  through 
densely  turbid  waters  where  neither  human  vision  nor  video  can  functlm. 
Spatial  resolution  or  video  can  be  made  to  approximate  that  of  the  eye  by 
focusing.  Present  advantages  of  manned  submerslbles  or  teleoperators  as 
work  vehicles  (neglecting  for  the  moment  personnel  rescue)  arex  steropsls 
for  close-tp  objects,  and  the  ability  of  a hxxman  observer  with  a wide  angle 
of  view  to  keep  track  of  the  relative  location  of  different  objects.  As 
the  conmunlcation  channel  iioproves,  to  the  point  %ihere  the  manipulator 
itself  is  the  limiting  factor,  a man  in  a submersible  can  control  manipu- 
lators or  video  pan-tilt  controls  just  as  well  as  a man  on  the  surface. 

The  major  difference  remaining  between  manned  sxxbsierslble  and  teleoperator 
are  then  cost  and  safety,  as  with  the  diver.  The  piesstire  vessel  and  life- 
support  equipment  make  the  manned  submersible  much  more  costly  than  the 
same  vehicle  without  the  pressure  vessel  and  life-svpport  equipment  but 
with  remote  control  instead.  The  factors  of  quality  and  reliability  of 
communication  and  remote  control  then  become  l^e  key  factors. 


3.  Why  Supervisory  Control  of  Teleoperators  Underseas?  Some  Assertions 
about  the  Probl^i. 


a.  Demands  ace  increasingly  stringent  in  terms  of  depth,  sensory  resolu- 
tion, speed  and  accuracy  of  power  of  iresponse  for  accomplishment  of  under- 
sea tasks.  Some  of  these  tasks  are  al«mys  the  same  and  are  amenable  to 
fixed  autcmatlon,  but  many  are  different  each  time  they  occur  and  therefore 
cannot  be  done  by  fixed  automation. 
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b«  In  terns  of  depth  and  skill  hiiman  divers  are  reaching  their  Units, 
or  when  they  go  beyond  these  linlts  they  do  so  at  significant  risk  to  life 
and  cost  in  support  equipment  and  personnel* 

c*  Teleoperators,  i.e*,sid)aier$lbles  having  video  and  other  sensors,  actu- 
ators for  nobility  and  nanipulatioa,  and  remotely  controlled  by  hunan  oper- 
ators, offer  much  prosilse  for  extending  man's  flexible,  adaptable,  perceiv- 
ing and  COTtrol  capabilities  into  remote  and  hazardous  environments* 

di,  Present  teleoperators  are  quite  limited  in  sensory  capability  (e*g*,in 
tuidsid  water),  in  manipulation  capability  (in  speed  and  dexterity  as  con^red 
to  human  hands),  and  in  dealing  with  distortion  in  man-machine  communication 
(misorientation  of  teleqperator  to  human  body,  time  delays  and  noise)* 

e*  CoRq>uters  are  rapidly  getting  smaller  in  size  and  power  requirement 
and  cheaper  in  cost  for  a given  computing  capability* 

f*  While  accomplishment  of  one-of-a-kind  \mdersea  tasks  by  Intelligent 
and  completely  autcxioiaous  robots  may  have  appeal,  we  sinply  do  not  have 
available  at  this  time  anx:h  devices  or  the  understanding  to  build  such  de- 
vices* 

g*  Undersea  systems,  like  aerospace  systems,  demand  conservative  design 
because  unreliability  poses  severe  costs* 

h*  The  most  immediate  and  reliable  approach  would  appear  to  be  to  add 
modest  coaputer  aiding  and  "artificial  intelligence"  to  teleoperators,  re- 
taining human  sensing,  motor,  memory  and  decision  capability,  at  least  for 
higher  level  planning,  decision-making,  and  ccxitrol* 

i*  Over  a longer  period  of  years,  as  cooputer  control  and  artificial  in- 
telligence become  more  sophisticated,  certain  human  functions  in  teleoper- 
atlon  may  be  replaced,  but  greater  need  and  demand  will  be  placed  upon 
other  human  functions,  and  in  these  respects  the  need  for  improved  man- 
computer  interaction  will  Increase,  not  diminish* 


4*  Relative  Roles  of  Man  and  Computer*  and  Man-Computor  Cowaunication* 

In  analyzing  the  relationship  between  human  operator  and  conputor  in 
teleoperation,  it  is  useful  to  consider  how  human  behavioral  components, 
through  two  basic  forms  of  conmiunication  are  used  in  four  human  supervisory 
roles*  Figure  2 summarizes  the  situation  by  arrows  indicating  causality 
between  descriptors* 

Commanding  the  conputor  is  done  by  either  typing  strings  of  symbols 
or  pushing  dedicated  buttons  or  switches  (symbolic  commands)  or  moving  a 
joystick  or  replica  controller,  where  there  is  a geometric  isomorphism  be- 
tween control  movement  and  its  meaning  (analogic  commands)*  Observing  can 
also  be  of  symbolic  displays  (alphanumerics)  or  analogic  displays  (pictures 
or  geometric  diagi^vns)*  Iraagining( internal  mental  visualization)  may  also 
be  symbolic  or  analogic* 
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Figure  2.  Relative  Roles  of  Man  and  Computer 
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Stq)ervl8ory  connands  may  be  for  purposes  of  planning  Information  t 
such  as  referencing  conf>uter  memory  or  testing  a potential  future  action 
on  a model;  they  may  be  for  ordering  teleoperator  action;  they  may  be 
for  making  computer  adjustsients  while  mcmltPrlng  teleoperator  action:  or 
they  may  be  for  Intervening  In  teleoperator  action  to  assume  direct  mantial 
control*  Observation  of  displays  is  Indicated  In  both  the  planning  and 
the  monitoring  role  of  the  operator* 

As  shown  in  the  fourth  row,  the  teleoperator  may  be  ordered  to  act 
in  tvro  different  w^ys*  One  is  tdiere  the  man  shares  control  with  the  com- 
puter«  i*e*  the  two  work  on  the  same  task  at  the  same  time*  The  other  is 
vrtiere  the  man  trades  control  on  all  or  some  of  the  tasks«  l*e*  for  those 
tpsks  he  gives  over  complete  ccvitrol  to  the  computer*  Intervention  means 
that  the  computer  trades  control  back  to  the  man*  When  control  has  been 
traded  to  the  computer,  part  of  the  act  of  monitoring  is  to  observe  (analogic 
and  symbolic)  displays  of  its  performance,  as  shown  by  the  upward  arrows* 

The  cosputer's  alternative  operating  roles  idien  sharing  control  with 
the  hiaaan  operator  are  relieve*  l*e*  do  things  which  make  his  woric  easier, 
and  extend*  i*e*  pushing  his  performance  beyond  tdiere  it  tiould  normally  be* 
When  control  is  traded  to  it  the  computer  may  backup  the  operator  by  being 
ready  to  take  over  in  case  he  falls,  or  it  may  replace  him  altogether* 

While  this  taxonomy  of  relationships  at  the  present  has  no  correspond- 
ing quantitative  theory,  it  has  been  useful  to  the  authors  in.  thiidcing 
about  vihat  is  desirable  for  man-computer  c<mtrol  of  teleoperators*  In  par- 
ticular it  has  helped  us  think  through  the  various  forms  of  computer  aiding 
which  might  be  programmed  into  an  experimental  system*  And  it  has  clarified 
for  us  the  potential  of  using  a combination  of  general  purpose  typewriter 
and  dedicated  on  special-purpose  keyboard  commands  (synftx>lic)and  force- 
reflecting  master-slave  and  rate  connands  (analogic)* 


5*  SUPEittftN;  A System  for  Supervisory  Manipulation 

A brief  description  of  a thesis  by  T*L*  Brooks  in  progress  at  the  Han- 
Hachine  Systems  Lab  at  MIT  is  given  on  the  following  pages  as  an  example 
of  a supervisory  manipulator  system*  This  system  is  called  SUPBRMkN*  Fig- 
ure 3 shows  the  general  relationships  between  the  multiple  inputs  (keyboard, 
dedicated  symbolic  keys,  and  analog  inputs),  the  computer  states  (STANDBY, 
DBPINB,  EDIT,  EXECUTE,  AND  TAKEOVER)  and  the  control  modes  (RATE,  MIXED 
MASTER/SLAVE  AMD  RATE,  MVSTER/SLAVE,  and  COMPUTER  control), 

STANDBY  State  - When  the  computer  is  in  this  state,  control  resides 
with  the  main  program  and  the  operator*  By  pressing  the  proper  buttcxi  on 
the  control  console,  the  user  can  enter  a particular  manual  ccmtrol  mode 
or  another  computer  state  (see  Figure  4)* 

Manual  Control  Mode  - A manual  control  mode  is  the  method  through 
which  the  user  analogically  interacts  %d.th  the  arms*  A control  mode  is 
independent  of  the  state.  For  example,  the  control  mode  might  be  HiSTER/ 
SLAVE  idille  the  state  is  EDIT*  niere  are  three  kinds  of  modest 
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Figure  3.  Block  Diagram  of  SUPERMAN  System 
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Figure  4.  Special  Control  Console  for  SUPERMAN  System 


a)  RA.TB  - The  individual  degrees  of  freedom  are  controlled 
through  rate  commands  by  switches  on  the  control  console  and  a poten* 
tlometer  for  rate  adjustment*  Both  rate  and  resolved-motion  rate  are 
available* 

b)  MIXED  MASTBR/SIAVB  AND  RATE  • The  master  acts  as  a spring- 
loaded  joystick  in  the  X,  Y and  Z axes«  giving  rate  ocmmands  to  the  X, 

Y and  Z axes  of  the  slave  proportional  to  displacement  of  the  master* 

(The  rate  of  the  slave  arm  is  then  reflected  in  the  force  feedback 
level  which  the  operator  feels  in  the  master*)  Both  rate  and  resolved 
motion  rate  control  are  available*  The  remaining  degrees  of  freedom^ 
the  left  and  right  elevation,  the  azimuth  and  the  end-effector  are  con- 
trolled in  a master/slave  mode* 

c)  MASTBR/SLAVB  - The  slave  arm  is  driven  to  duplicate  in  position 
the  action  of  the  master*  Any  force  felt  by  the  slave  is  reflected  to 
the  master  giving  the  operator  force  feedback  (l*e.  proportional  to 
position  disparity  between  master  and  slave) • 

DEFINE  - DEFINE  is  the  primary  state  through  v^lch  the  operator  enters 
a string  of  commands  to  be  executed*  Commands  are  entered  by  pressing 
specially  dedicated  buttons  for  each  function*  All  of  the  buttons  used  in 
the  OEPINB  state  have  dual  functions  (see  Figure  4 - dual  function  buttons 
are  0-15)* 

EXECUTE  State  - As  the  title  implies,  the  string  of  commands  is  exe- 
cuted through  this  state.  Dturing  the  execution  of  the  command  register, 
if  the  operator  desires  to  take  control,  there  are  two  methods  available. 
The  operator  can  take  immediate  control:  (1)  by  pulling  on  the  appropriate 
control  stick  (i.e.  the  MASTER  in  the  case  of  MASTER/SIAVE  or  MIXED 
HASTBR/SLAVB  AND  RATE  modes  or  the  rate  switches  in  the  RATE  mode),  or 
(2)  by  pressing  the  STOP  button  (all  action  ceases  after  the  STOP  button 
has  been  pressed  vtntil  the  operator  signals  for  continuation  or  return 
to  STANDBY).  The  operator  can  execute  a string  of  commands  Which  have 
been  saved  as  a task  file  by  pressing  one  of  the  lighted  TASK  FILE  buttons* 
The  operator  also  has  the  option  of  executing  the  current  command  register 
by  pressing  the  EXECUTE  button*  This  allows  the  operator  to  define  a 
string  of  commands  and  immediately  execute  them  to  determine  if  any  modi- 
fications are  necessary*  After  the  operator  is  sure  the  command  string 
performs  the  desired  function  correctly,  that  function  can  then  be  saved 
as  a task  file  or  a named  file* 

TAKEOVER  State  - TAKEOVER  is  a transition  state  between  control  modes, 
l*e*  from  conputer  control  to  the  control  mode  in  effect  before  the  EXECUTE 
comnand*  Special  problems  result  during  this  state  due  to  the  mismatch 
between  the  master  and  the  slave  at  the  time  of  the  takeover*  The  diamond 
in  Figure  3 signifies  that  after  the  mismatch  has  been  dissolved,  the  op- 
erator has  the  option  of  moving  into  the  STANDBY  state  or  continvdng  the 
BXECUTKXl  state* 

The  detailed  meanings  of  the  DEFINE  buttons  0-15  are  given  below: 
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BUTTON 

Number  Command 

0 END 

Final  command  used  to  signal  completion  of  DEFINE  state. 

1 SAVE 

Used  to  save  the  command  register  on  the  disk  as  either 
a task  file  or  a named  file.  A task  file  can  be  recalled 
o.nly  by  one  of  eight  buttons  in  the  STANDBY  state*  whereas 
a named  file  is  saved  under  a user-designated  title  and 
can  only  be  recalled  by  the  same  name  through  the  GET  but- 
ton (6)  in  the  DEFINE  state. 

2 EDIT 

The  EDIT  command  allows  the  user  to  modify  the  comnand 
register.  The  following  options  are  available  through  the 
keyboard  after  entering  the  EDIT  state; 

a)  CHANGE  A LINE 

b)  INSERT  A LINE 

c)  DUPLICATE  A LINE 

d)  DELETE  A LINE 

e LIST  COMMAND  REGISTER 
f)  RETURN  TO  DEFINE 

3 2ND 

Used  to  enter  the  second  function  of  dual  comnand  keys. 

The  first  function  of  each  key  is  printed  in  black  letters 
above  the  button.  The  second  function  is  written  below 
the  button  in  gold  letters.  To  enter  a second  function 
command,  press  the  2ND  key  and  then  the  desired  second  com- 
mand. 

4 ERASE  LAST  LINE  [ERASE] 

Used  to  erase  the  last  entry  in  the  command  register, 

5 GET 

Used  to  retrieve  a named  command  file  from  the  disk. 

GET  asks  for  the  name  of  the  command  file  to  be  recalled 
and  then  locates  the  file,  reads  it  into  the  comnand  register 
(and  returns  to  DEFINE  state). 

6 RESET 

Used  to  initialize  the  necessary  internal  variables  and  the 
command  register  to  zero. 
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7 THROUGH  PATH  [TPATH] 

Records  the  present  position  of  the  arm  for  use  in  EXECUTE 
as  a through  point.  (A  through  point  is  a position  which 
the  operator  desires  the  arm  to  move  through  without  stop- 
ping, i.e.  non-zero  velocity  point.) 

8 INCREMENT  (DOF)  (XXXX) 

Makes  an  incremental  motion  in  the  desired  degree  of 
freedom  by  a selected  value.  The  user  enters. the  INCREMENT 
command,  then  the  degree  of  freedom  (DOF),  adjusts  the 
desired  increment  (XXXX)  through  the  potentiometer  and 
presses  the  READ  POT  VALUE  button  directly  beneath  the 
potentiometer. 

9 IF  (DOF)  FORCE. 6T. 

EXECUTE  NEXT  COMMAND 

If  the  force  level  in  the  desired  degree  of  freedom 
(DOF)  is  greater  than  the  level  set  by  the  operator  (XXXX) 
the  following  command  is  executed.  If  the  force  level  is 
less  than  the  level  set  by  the  operator,  the  command  immedi- 
ately following  the  IF  FORCE, GT.  statement  is  skipped  during 
execution.  The  user  enters  the  IF  FORCE. GT.  command,  then 
tr.3  desired  degree  of  freedom,  adjusts  the  force  level  through 
the  potentiometer. 

10  GRASP  WITH  FORCE  (XXXX)  [GRASP] 

The  user  enters  the  GRASP  command  and  adjusts  the  force 
level  through  the  potentiometer. 

11  DISCRETE  PATH  [DPATH] 

Records  the  present  position  of  the  arm  for  use  in 
EXECUTE  as  a stopping  point.  During  execution,  the 
slave  arm  is  moved  from  its  current  position  to 
the  recorded  position  with  zero  final  velocity. 

12  LABEL  (XXXX) 

Labels  a position  in  the  comnand  register  which  can  be 
returned  to  through  a GOTO  command.  The  user  presses  the 
LABEL  button  and  then  the  number  (XXXX)  of  the  desired 
label . 

13  GOTO  (XXXX) 

GOTO  is  a conditional  command  which  moves  to  label  (XXXX), 

unless  the  operator  signals  during  execution  to  change  the 
branch  to  (YYYY)  by  pressing  a different  button.  To  enter 
the  command  the  operator  presses  the  GOTO  button  and  then 
the  number  (XXXX)  of  the  label  to  which  GOTO  should  branch. 
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14  OPEN 
Open  jaws. 

15  CONTINUOUS  PATH  [CPATHJ 

Records  the  position  of  the  master  manipulator  every  0.1 
second  for  use  in  EXECUTE.  A continuous  path  is  achieved 
by  interpolating  between  the  recorded  positions. 

2ND  - 0 ABSOLUTE 

Informs  the  execution  compiler  that  the  command  register 
is  to  be  executed  exactly  as  recorded  (see  RELATIVE).  The 
user  enters  the  absolute  command  by  pressing  the  2ND 
button  (H)  and  then  the  ABSOLUTE  button  (#0). 

2ND  - 1 RELATIVE 

Informs  the  execution  compiler  that  the  positions  in  the 
command  register  are  to  keep  the  same  relative  displacement 
with  respect  to  each  other,  but  are  to  be  transformed  so 
that  the  first  position  following  the  RELATIVE  coimnand 
corresponds  to  the  position  of  the  slave  at  the  time  of 
execution.  A RELATIVE  command  can  be  cancelled  by  an 
ABSOLUTE  command,  with  the  result  that  only  the  positions 
between  the  RELATIVE  and  ABSOLUTE  commands  are  transfonned. 
The  user  presses  the  2NB  button  (#4)  and  then  the  RELATIVE 
button  (#1)  to  enter  the  command  in  the  register. 

2ND  - 2 
through 

2ND  - 15  not  assigned. 


As  an  example  program  consider  a string  of  commands  to  take  a nut  off 
of  a bolt  and  put  it  in  a box.  This  program  can  be  broken  down  into  two 
major  sections,  one  removes  the  nut  and  the  other  places  it  in  the  box* 

Since  the  user  would  prefer  one  nut  removal  program  to  be  used  for  all  nuts 
regardless  of  the  orientation  of  the  nut,  a RELATIVE  command  should  obviously 
be  the  first  command  in  the  register  (the  RELATIVE  command  and  all  of  the 
following  commands  are  briefly  described  under  DEFINE).  The  entire  command 
register  for  the  nut  removal  program  would  be  as  follows.  The  following 
general  formats  will  be  followed  throughout  this  example: 

rBUTl’ON  PUSH) 
vPOT  READINGS) 

"KEYBOARD  COMMANDS" 

COMPUTER  REPLIES. 
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1 [REUTIVE] 

2 {LABEL]  II] 

3 [DPATH] 


4 (GRASP] (200) 

5 [DPATH] 


6 [INCREMENT]  [Y] (300) 


7.  [IP  force.g;.][y]  (100) 

8 [GOTO]  [2] 

9 [GOTO]  [3] 


Place  the  slave  on  a nut  and  record 
that  position  by  pressing  the  DPATH 
button. 


Turn  the  end  effector  180*  and  record 
the  position. 

Increment  the  slave  by  300  counts  in  the 
direction  that  would  pull  the  nut  off. 

If  the  force  is  greater  than  100  in  the 
Y direction,  the  nut  is  still  on  the 
bolt,  therefore  execute  the  next 
command. 


If  the  force  had  been  less  than  100  in 
the  Y direction,  the  nut  is  free  and 
this  command  would  be  executed. 


10  [LABEL]  [2] 

11  (INCREMENT]  [Y]  (-300) 

12  [OPEN] 

13  [GOTO]  [1] 

14  [UBEL]  [3] 

[SAVE]  "NUT-OFF'' 


Return  the  arm  to  position  before 
incrementing  in  H. 

Release  the  nut> 

Return  to  LABEL  1 and  continue  turning 
the  nut. 

End  of  the  first  part  of  task  - nut 
is  off. 

Save  command  register  as  the  named 
file  "NUT-OFF"  (typed  in  at  the  keyboard). 


The  second  part  of  the  task  requires  the  manipulator  to  place  the  nut 
in  a box.  The  entire  command  register  for  the  program  to  put  the  nut  in  the 
box  would  be  as  follows: 
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1.  [ABSOLUTE] 

2 [TPATH] 

3 [DPATHJ 

4 [OPEN] 

5 [TPATH] 

[SAVE]  "NUT-IN-BUX” 


The  box  would  always  be  in  the  same 
place. 

Hove  the  slave  to  a position  Just  over 
and  above  the  outside  edge  of  the  box 
and  record  this  position  by  pressing 
the  TPATH  button. 

Move  the  slave  to  a position  over  the 
center  of  the  box  and  record  the 
position. 


Enter  sane  position  as  in  #2  by 
duplicating  line  2. 


At  this  point  the  operator  could  call  either  program  and  execute  it. 

The  NUT’^FF  program  would  simply  take  the  nut  off  and  return  control  to  the 
operator  as  soon  as  the  nut  was  free.  But  the  present  status  of  each  file 
(l.e..  a named  file)  requires  that  the  operator  type  in  each  name  to 
obtain  the  file  to  execute  it.  If  the  operator  performs  the  following 
commands  the  file  will  be  saved  as  a task  file  which  is  immediately  executed  at 
the  touch  of  a button: 

[GET]  ”NUT-OFF” 

[GET]  "NUT-IN-BOX" 

The  computer  will  reply  by  stringing  the  two  files  together  as  one  file. 

Then  enter: 

[SAVE]  "TASK-FILE" 

and  press  the  button  which  will  retrieve  the  file  (e.g. , button  #1).  To 
remove  a nut  and  put  it  in  the  box  the  operator  simply  presses  the  same 
button*  the  execution  compiler  transforms  the  first  half  of  the  register 
relative  to  the  position  of  the  slave  at  the  instant  the  button  is  pressed 
and  then  executes  the  program.  After  the  nut  is  removed  and  placed  in  Che 
box  the  slave  returns  to  the  operator's  position  and  the  computer  relinquishes 
control. 
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Abstract 


A "predictor"  display  superimposed  on  slow-scan  video  or  sonar  data  is 
proposed  as  i method  to  allow  better  remote  manual  control  of  an  untethered 
submersible.  Simulation  experiments  show  good  control  under  circumstances 
which  otherwise  make  control  practically  impossible. 


1.  Introduction 


Untathered,  unmanned  submersibles  have  been  limited  to  automatic  control 
on  simple  pre-programmed  or  target-seeking  trajectories.  More  precise  navi- 
gation and  obstacle  avoidance  will  require  increasingly  sophlsicated  auto- 
matic control  and/or  direct  control  from  the  surface.  Direct  human  control 
through  a sonic  communication  channel  will  be  difficult  because  -*f  the  low 
bandwidth  and  the  signal  travel  time.  Probably  the  most  productive  approach 
will  Le  a combination  of  e.lementary  automatic  control  such  as  is  possible 
with  some  present-day  tethered  submersibles  (e.g.,  altitude  or  depth  and 
heading  control)  plus  display  aids  which  make  control  easier  for  the  operator. 
This  paper  proposes  a display  aid  vrhlch  is  particularly  applicable  to  the 
problems  of  time-delay  and  slow  frame-rate, 


2 . The  Problem 


For  remote  control,  there  are  two  sources  of  difficulty  with  sonar 
communications:  time-delay  and  slow-frame-rate.  Round  trip  time-delay  is 

the  time  for  a command  to  travel  to  the  vehicle  and  the  first  Indication  of 
response  to  travel  back.  At  a minimum  this  will  be  two  times  the  distance 
divided  by  the  speed  of  propagation,  2T.  For  e:{ample,  T ~ 1 second 

at  about  5,000  feet. 


Pictorial  information  from  television  camera  or  obstacle  avoidance  scnar 
will  be  further  delayed  because  of  limited  channel  capacity.  Assuming  a 
low  resolution  picture  of  80  K bits  and  a channel  capacity  of  lOK  blts/sec., 
there  would  be  at  mos*",  one  picture  every  8 seconds  (S  ■ 8 seconds). 


The  effects  of  trying  to  navigate  with  Just  this  pictorial  information 
are  illustrated  in  Figure  1. 


* 


This  work  wat  supported  in  part  by  ONR  Contract  N00014-77-C-0256.  The 
untethered  vehicle  control  problem  was  suggested  in  discussions  with  the 
Harbor  Branch  Foundation  and  the  M.I.T.  Office  of  Sea  Grant. 
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Figure  la.  Effect  of  delays  from  transport  time  (T)  and  scan  time  (S). 

The  picture  from  Q is  received  T + S seconds  after  it  is  taken;  the 
first  operator  response  is  received  by  the  vehicle  at  least  T seconds  later, 
for  a total  delay  of  2T  -f  S seconds.  While  Che  operator  is  looking  at  the 
still  picture  from  0 the  commands  he  is  sending  are  actually  moving  the 
vehicle  from  1’  to  2’,  as  Illustrated  in  Figure  lb. 
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Predictor  Display 


ORIGINAL  PAGE  IS 
OP  POOR  QUALITY 


Predictor  displays  were  first  used  for  submarine  control  (Kelley,  1968). 

NASA  considered  predictor  displays  for  remote  control  of  unmanned  lunar 
roving  vehicles  (Arnold,  1963)  but  sent  men  instead. 

The  predictor  display  proposed  here  presents  a symbol  superimposed  on 
the  slow-frame-rate  and  time-delayed  picture  from  the  vehicle's  television 
camera.  The  symbol  responds  instantansously  and  continuously  to  the  operator's 
commands  predicting  "future"  positions  of  the  vehicle.  Por  example,  refering 
to  Figure  lb,  when  0 is  complete  the  predictor  symbol  would  show  the 
position  1'.  Before  the  next  picture  from  Q arrives,  the  symbol  will  be 
moved,  in  response  to  the  operator's  commands,  to  position  2'. 

The  position  of  the  vehicle  is  computed  from  a local  model  of  the  vehi- 
cle response  and  the  operator's  commands  u(t),  as  shown  in  Figure  2. 


Pictorial  or  Map  Displays 


The  predictor  symbol  may  prove  useful  both  on  pictorial  displays 
(superimposed  on  television  or  obstacle-avoidance  sonar)  and  on  map-like 
position  displays.  Map  displays  would  avoid  one  difficulty  of  pictorial 
displays,  which  is  loosing  the  predictor  symbol  when  it  moves  out  of  the 
field  of  view  of  the  camera  (for  example,  moving  sideways  oi.  backward). 
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Auxiliary  Position  Data 


If  position  data  is  available  from  transponders  or  locator  beacons,  it 
could  be  used  to  update  the  vehicle  model.  With  just  the  pictorial  data, 
the  open-loop  prediction  would  have  to  span  an  interval  of  (at  least)  2T  + S 
to  ( at  most)  2T  + 2S  seconds.  With  auxiliary  feedback  the  open-loop 
estimate  will  only  need  to  span  the  delay  of  that  auxiliary  data  (at  minimum 
2T^.  The  signals  and  corresponding  delays  are  shown  in  Figure  3.  (u(0# 

command  vector;  x(*),  vehicle  location  data). 


Figure  3.  Delays  associated  with  predictor  calculation 
Adaptive  Estimation 

Another  feature  that  could  be  built  into  the  local  model  of  the  vehicle 
is  some  estimate  of  the  disturbances  (such  as  current).  The  current  model 
as  well  as  the  vehicle  model  could  be  updated  on  the  basis  of  the  mismatch 
between  predicted  and  measured  vehicle  position. 

4.  A Demonstration  Experiment 


In  order  to  explore  the  effects  of  the  predictor  display,  an  interactive 
simulation  was  written  on  an  Interdata  70  computer  and  Imlac  graphic  display. 

A random  terrain  was  generated  and  displayed  in  perspective,  updated  every 
8 seconds,  to  simulate  the  pictorial  information.  A moving  predictor  symbol 
was  generated  respresentlng  the  vehicle  as  a square  in  perspective.  Two  straight 
ridges  were  added  to  the  random  terrain  to  serve  as  a test  course.  (Figure  4). 
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Figure  4.  Computer-generated  terrain  with  predictor  symbol 

The  simulated  vehicle  was  controlled  by  the  operator  with  a spring- 
centered  2-degree-of -freedom  joystick.  The  dynamic  response  of  the  vehicle 
was  simple  integration  with  forward  speed  proportional  to  forward-back 
position  of  the  stick  and  turn-rate  proportional  to  left-right  position 
of  the  stick.  . The  vehicle  was  always  the  same  height  above  the  terrain 
(simulating  automatic  altitude  hold) , No  disturbances,  such  as  currents 
were  simulated.  Also,  it  was  found  important  to  have  a good  detent  and 
dead-zone  on  the  sltck  to  avoid  inadvertent  commands. 

A stationary  "table"  was  drawn  to  indicate  where  the  next  picture 
was  to  come  from  while  the  "real-time"  predictor  continued  to  move  in 
response  to  the  operator’s  commands  (Figure  5).  Dotted  lines  were  added 
to  this  table  to  Indicate  the  field  of  view.  This  reduced  the  considerable 
confusion  about  how  the  picture  was  expected  to  change  and  served  as  a guide 
for  keeping  the  vihlcle  within  its  own  field  of  view,  which  is  the  best 
strategy  for  using  this  kind  of  predictor  on  the  pictorial  display. 


Figure  5.  Predictor  plus  "table"  showing  from  where  next  picture  will  come 
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Results 


A typical  patht  without  the  predictor « Is  shown  In  Figure  6.  The  dotted 
lines  represent  +1 terrain-unit  from  the  ridge.  The  circles  represent  the 
vehicle's  position  every  2 seconds.  V's  represent  the  field  of  view  of  each 
picture  sent.  Quite  often  there  Is  no  movement  between  successive  dots  (2 
secs.)  or  successive  pictures  ( 8 seconds.) 


Figure  6.  Typical  path  with  Figure  7.  Success  at  slow  speed 

no  predictor  with  no  predictor 


Only  with  extremely  slow  speed  was  it  possible  to  keep  track  of  the 
ridge.  Approximately  five  minutes  and  40  pictures  were  required  to  traverse 
just  one  of  the  ridges  (half  the  course)  This  la  shown  In  Figure  7. 

With  the  predictor  symbol,  practically  continuous  motion  was  possible. 

A typical  path  is  shown  In  Figure  8,  The  course  was  completed  In  3 minutes 
and  23  pictures. 
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Figure  8.  Path  with  predictor  display 


Request  Mode 


One  unexpected  finding  from  these  experiments  was  that  rather  than 
sending  the  picture  periodically  every  eight  seconds,  sending  the  picture 
only  upon  the  operator's  request  reduces  the  total  number  of  pictures 
necessary  and  encourages  a "move  and  wait"  strategy  which  avoids  confusion. 
The  difference  is  Illustrated  in  Figure  9. 


Figure  9a.  New  picture  every  8 seconds:  "periodic  mode" 
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Figure  9b.  New  picture  upon  request;  "request  mode" 


In  the  periodic  mode  (Figure  9a)  a short  move  starting  with  the  receipt 
of  picture  Q will  not  be  reflected  in  the  next  picture,  , as  the  opera- 
toi  might  expect;  Instead  he  has  to  wait  for  Q . In  request  mode 
(Figure  9b),  the  wait  for  pictorial  onfirmation  is  minimized. 


Figure  10.  Typical  path  in  the  request  mode 
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A typical  path  in  request  mode  (using  the  predictor)  is  shown  in 
Figure  10.  Compared  to  periodic  mode^  the  time  is  about  the  same  but  the 
number  of  pictures  used  in  one-half  to  one-third;  velocities  are  higher  but 
there  is  a wait  for  10  seconds  as  each  picture  is  taken  and  sent. 

On  an  actual  vehicle,  probably  both  modes  should  be  available  with  the 
request  mode  used  when  move-and-walt  strategy  is  appropriate  (for  precise 
positioning  based  on  pictorial  feed-back,  and  when  environmental  disturbances 
arst  small) . Periodic  mode  is  probably  more  appropriate  for  less  precise 
navigation  and  continuous  motion  when  the  predictor  symbol  can  be  relied 
upon. 


Another  trade-off  that  should  probably  be  built  into  the  pictorial  feed- 
back is  variable  frame-rate/resolution.  In  a more  dynamic  and  uncertain 
environment  (l.e.,  larger  bandwidth  disturbances  or  target  motion)  sampling 
rate  will  want  to  be  higher  at  the  expense  of  resolution. 

6.  Conclusions  and  Recommendations 

For  the  conditions  studied  (T  * 1 sec.,  S • 8 sec.)  manual  control  is 
not  feasible  wlthcat  display  aids  such  as  the  predictor  symbol.  The  request 
mode  is  preferred  as  it  seems  to  avoid  confusion  and  reduce  the  number  of 
pictures  necessary. 

The  present  results  are  at  best  preliminary.  We  studied  only  very 
simple  vehicle  dynamics  and  only  one  set  of  delay  conditions.  Further  study 
with  laboratory  simulation  can  investigate: 

1)  more  realistic  vehicle  dynamics, 

2)  environmental  uncertainties  such  as  drift, 

3)  a broader  range  of  delay  conditions  and 

4)  various  degrees  of  partial  automation. 

Also,  the  predictor  displays  (both  pictorial  and  map)  could  be  used 
on  existing  tethered  vehicles  to  simulate  untethered  operation  and  evaluate 
th'.  potential  for  untethered  operation. 
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8UMMABI 

A study  was  conducted  to  explore  the  feasibility  of  a safety  margin  and 
flight  reference  system  for  those  pcwered-llft  aircraft  which  require  a back- 
side piloting  technique.  The  main  objective  was  to  display  multiple  safety 
margin  criteria  as  a single  variable  which  could  be  tracked  both  manually  and 
automatically  and  which  could  be  monitored  in  order  to  derive  safety  margin 
status.  The  study  involved  a pilot-in- the- loop  analysis  of  several  system 
concepts  and  a simulator  experiment  to  evaluate  those  concepts  showing  promise. 
A system  was  ultimately  configured  which  yielded  reasonable  compromises  in 
controllability,  statvjs  information  content,  and  the  ability  to  regulate 
safety  margins  at  some  expense  of  the  a1J.owable  low  speed  flight  path  envelope. 
It  was  necessary,  however,  to  utilize  an  integrated  display  of  two  variables  — 
one  to  be  tracked  in  a compensatory  manner  and  one  to  be  monitored.  The 
variables  themselves  consisted  of  linear  combinations  of  the  computed  critical 
safety  margin  and  pitch  attitude,  and  the  proportions  of  ‘'.he  combinations  were 
definable  in  terms  of  the  aforementioned  compromises. 

8IMB018 


k WeijditJjig  coefficient  for  pitch  attitude 

Njj  Engine  ipm 

V Airspeed 

\dn  Minimum  airspeed  at  approach  thrust 

^mi%  Minimum  airspeed  at  maximum  thrust 

a Angle  of  attack 

Maximum  allowable  angle  of  attack 
y Aerodynamic  flight  path  angle 

0 Pitch  attitude 


* This  study  was  performed  under  Contract  NAS£2*«94l8. 

IN^flTIONALLY  BLANK' 
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smosocTiov 


The  pilot's  control  technique  for  a powered- lift  aircraft  in  the  approach 
flight  phase  is  Inherently  different  from  that  for  a conventional  aircraft. 

The  pilot  (or  autopilot)  of  the  powered-lift  aircraft  cannot  simply  use  1 .3 
times  the  power-off  stalling  speed  (for  the  approach  configuration)  as  the 
target  airspeed  or  "flight  reference”  and  he  guaranteed  adequate  safety 
margins.  Since  a powered- lift  aircraft  derives  a significant  part  of  its 
lift  from  a thrust  vector  which  is  Inclined  nearly  pezpendioulax’  to  the  flight 
path,  the  minimum  speed  is  determined  to  a large  extent  by  the  thrust  or 
power  setting.  This  is  in  dramatic  contrast  to  the  characteristics  of  a con- 
ventional aircraft  as  shown  in  Fig.  1 . Note  that  the  approach  speed  for  a 
powered-lift  aircraft  may  be  in  the  neighborhood  of  the  idle  thrust  stalling 
speed  (Point  A in  Pig.  1). 

In  addition  to  the  problem  of  selecting  a suitable  speed  (or  other 
parameter)  to  use  as  a flight  reference  which  will  ensure  adequate  safety 
margins,  the  pilot  may  have  to  cope  with  some  other  rujusual  flight  character- 
istics. For  example,  roost  powered- lift  aircraft  approach  at  speeds  on  the 
"backside"  of  the  thrust  required  curve.  Consequently,  a "backside"  or  "STOL" 
control  technique  is  usually  used,  i.e.,  the  pilot  uses  pitch  attitvide  to 
regulate  airspeed  and  modulates  thrust  to  control  flight  path.  A typical 
flight  chara- beristic  resulting  from  this  mode  of  control  and  from  the  thrust 
vector  being  inclined  nearly  perpendicular  to  the  fli^t  path  is  shown  in 
Fig.  2.  That  is,  if  the  pilot  is  using  airspeed  as  a flight  reference  (i.e., 
maintaining  a constant  airspeed),  it  can  be  seen  that  to  steepen  the  descent 
path  angle  the  pilot  must  increase  pitch  attitude'.  This  is  contradictory  to 
all  normal  practice  and  can  make  airspeed  a very  confusing  flight  reference. 

Because  of  these  problems,  the  pilots  of  airplanes  such  as  the  NASA 
Axignentor  Wing  Jet  STOB  Research  Aircraft  (AWJSRA)  must  use  a combination  of 
airspeed,  angle  of  attack,  and  pitch  atti tilde  as  a flight  reference.  Only 
through  extensive  experience  are  these  pilots  able  consistently  to  maintain 
adequate  safety  margins.  While  this  use  of  a complex  flight  reference  has 
been  acceptable  in  the  research  environment,  it  would  not  be  acceptable 
operationally. 


OiJlOIXVI 


The  objective  of  the  program,  therefore,  was  to  find  a single  display 
to  be  used  for  maintaining  a safe  flight  condition  in  powered- lift  aircraft. 
Several  features  needed  to  be  considered,  however,  which  significantly  compli- 
cated the  design  of  such  a system.  These  are  shown  in  Fig.  5* 

The  present  study  was  primarily  a feasibility  study  and  was  limited  to 
an  analysis  and  simulation  phase.  The  results  to  be  presented  were  obtained 
in  the  context  of  (i)  an  existing  powered-lift  STOL  airplane  (NASA  AWJSRA), 
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Figure  2,  7 - V Curve  Showing  Region  of  Adverse  Cross  Coupling 

Along  Trajectory  of  Desired  Airspeed. 


Figure  3.  Tradeoffs  Involved  in  the  System  Design. 
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(lx)  existing  avionics  hardware  (STOLAKD  guidance,  control,  and  imvigation 
system,  Ref.  1 ),  and  (iii)  severe  atmospheric  disturbances  encountered  during 
the  landing  approach  flight  phase. 


TECHNICAL  AFFRQACK 


An  extensive  study  of  aiiworthiness  requirements  which  is  described  in 
Refs . 2 and  5,  defined  the  required  safety  margin  criteria  for  powered-lift 
aircraft  in  teims  of  the  instantaneous  angle  of  attack  and  airspeed.  The 
suggested  criteria  from  Ref.  2 are  listed  in  Table  1 . Figure  4 shows  these 
criteria  superimposed  on  the  AWJSRA  fli^t  envelope.  The  present  study 
assumed  these  safety  margin  criteria  for  the  jjurpose  of  defining  the  avail- 
able flight  envelope.  Note  that  only  two  criteria  dominate,  i.e.,  airspeed 
must  be  greater  than  the  minimum  speed  at  maximum  thrust  plus  20  knots  and 
the  angle  of  attack  must  be  such  that  a 20  knot  vertical  gust  will  not  result 
in  exceeding  the  maximum  allowable  angle  of  attack.  The  resulting  fli^t 
envelope  is  bounded  in  Fig.  4 by  the  lines  labeled  "minimum  safe  airspeed.” 


Table  1 . Safety  Margin  Criteria. 
(All  Engines  Operating) 


V > 1.15  (approach  thrust) 

V > + 10  knots  (approach  thrust) 

V > V.5  Vjjinm  (®®ximum  thrust) 

V > + 20  knots  (maximum  thrust) 

a < a - sin"^  ^ (vertical  gust  margin) 

luoJv  V 


Most 

Critical 

Criteria 
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VELOCITY 


Figure  4.  Relationship  of  Various  Safety  Margin  Criteria. 
(Corresponding  to  Table  1 for  the  AWJSRA.) 


A large  number  of  possible  flight  reference  and  safety  margin  mechani- 
zations that  were  consistent  with  this  flight  envelope  were  examined  and  are 
described  in  detail  in  Ref.  k . The  analysis  utilized  multiloop  control 
system  analysis  methods  and  considered:  (l)  ease  of  control,  (2)  display  of 

safety  margin  status,  (3)  pilot  and  automatic  system  performance  in  maintain- 
ing safety  margins,  and  (4)  system  mechanization  as  they  relate  to  sensor 
and  computational  requirements.  The  purpose  of  the  analysis  was  to  sort 
through  the  large  munber  of  possibilities  to  find  a few  wliich  would  be  worth- 
while examining  during  the  simulation  phase. 


From  the  large  number  of  implementation  concepts  ''  ^nsidered,  one  was 
found  to  meet  design  objectives  satisfactorily.  Although  it  consisted  of  a 
single  display,  two  variables  were  Involved.  One  variable  was  actively 
tracked  and  thus  served  a&  a flight  reference.  The  other  variable  was  simply 
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monitored  in  order  to  obtain  hi^  quality  status  information.  This  imple- 
mentation can  be  stonmarized  as: 

[Tracked  Variable]  = [Actual  Margin]  + k • [Pitch  Attitnde] 
[Monitored  Variable]  = [Actual  Margin] 


where  the  actual  margin  is  taken  as  the  most  critical  of  applicable  airspeed 
and  angle  of  attack  safety  margin  criteria  from  Table  1 . 

It  is  significant  that  the  tracked  variable  was  conposed  of  a simple 
linear  conflaination  of  actual  margin  and  pitch  attitude.  This  implementation 
permitted  a direct  tradeoff  between  ideal  status  information  and  easy  con- 
trollability depending  upon  the  weighting  factor,  k.  A single  value  of  k 
was  found  to  provide  satisfactory  compromises  in  the  various  tradeoffs  shown 
previously  in  Fig.  5*. 

The  manner  in  which  the  two  variables  were  displayed  was  important  to 
tte  success  of  the  system.  The  main  hardware  element  of  the  display  was  the 
STOLAUD  Electronic  Attitude  Director  Indicator  (EADI)  shown  in  Fig.  5. 

Safety  margin  information  was  presented  along  the  vertical  scale  on  the  far 
left-hand  side. 


Figure  5.  Overall  EADI  Presentation. 


* This  value  amounted  to  10^  safety  margin  change  per  degree  pitch  attitude 
change  where  the  nominal  operating  point  was  at  100^  allowable  safety 
margin. 
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Details  of  the  safety  margin  system  presentation  are  described  in 
Fig.  6.  Mote  that  the  tracked  variable  is  displayed  directly  on  the  moving 
pointer,  but  that  the  monitored  variable  is  displayed  as  the  distance  between 
the  moving  pointer  and  a moving  scale  "floor."  This  configuration  provided 
good  relative  emphasis  on  the  two  variables  and  did  not  confuse  their  respec- 
tive roles  in  the  pilot's  mind. 


COMCLUSIOMS 


The  study  reported  in  this  paper  was  successful  in  evolving  a useful 
safety  margin  system  and  display  for  a powered- lift  aircraft.  The  fli^t 
reference  implementation  found  most  effective  involved  a blend  of  the  safety 
margin  and  a linear  function  of  pitch  attitude.  This  concept  provided 
(i)  an  easily  controlled  variable,  (ii)  correct  sensitivity  to  gusts,  (iii) 
a guide  to  correct  control  action  for  obtaining  good  safety  margin  performance, 
(iv)  acceptable  performance  in  the  presence  of  large  atmospheric  distijrbances, 
and  (v)  the  concept  was  relatively  easily  implemented.  The  main  compromise 
resulting  from  the  use  of  this  concept  was  a reduction  in  available  flight 
envelope  in  order  to  enhance  certain  controllability  features.  (The  nominal 
operating  point  was  approximately  5 knots  faster  than  the  minimum  approach 
speed  permitted  by  applicable  safety  margin  criteria. ) The  envelope  coitpro- 
mise  was,  however,  controllable  in  a rational  and  predictable  way  by  the 
flight  reference  weighting  coefficient.  Finally,  the  results  of  the  study 
have  provided  the  necessary  groundwork  for  a flight  investigation. 
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SUMMARY 


During  mid-air  retrieval  of  parachute  packages,  the  absence  of  a natural 
horizon  creates  serious  difficulties  for  the  pilot  of  the  recovery  helicop- 
ter. A head-up  display  (HUD)  was  tested  in  an  attempt  to  solve  this  problem. 
Both  a roll-stabilized  HUD  and  a no-roll  (pitch  only)  HUD  were  tested. 

The  results  show  that  fewer  missed  passes  occured  with  the  roll-stabi- 
lized HUD  when  the  horizon  was  obscured.  The  pilots  also  reported  that  the 
workload  was  greatly  reduced.  Roll-stabilization  was  required  to  prevent 
vertigo  when  flying  in  the  absence  of  a natural  horizon.  Any  HUD  intended 
for  mid-air  retrieval  should  display  pitch,  roll,  sideslip,  airspeed,  and 
vertical  velocity. 


INTRODUCTION 


One  of  the  most  successful  ways  to  recover  drones  is  the  mid-air  re- 
trieval system  (MARS).  During  these  recoveries,  a parachute  system  is  de- 
ployed from  a descending  drone  prior  to  retrieval.  A typical  parachute  sys- 
tem consists  of  an  engagement  parachute  connected  by  a load  line  to  the  drone 
and  a main  parachute  canopy  supporting  the  drone.  The  main  canopy  is  de- 
signed to  release  when  the  load  line  from  the  drone  to  the  engagement  para- 
chute is  under  tension.  The  load  line  is  routed  up  the  main  canopy  risers 
to  a break-tie  at  its  apex,  then  up  to  the  engagement  parachute. 

To  recover  the  drone  or  other  object,  the  pilot  Flies  the  helicopter  to 
approach  the  engagement  parachute  from  the  side  opposite  the  load  line. 

asi  iAOE^TEmiONALLY  BLANK 


This  location  is  shown  by  an  aiming  panel  on  the  main  canopy.  The  helicopter 
has  three  hooks  rigged  below  it  which  catch  load  carrying  members  in  the  en- 
gagement parachute.  These  hooks  are  connected  to  an  energy  absorbing  winch 
aboard  the  helicopter.  As  the  load  line  absorbs  the  tension  after  engage- 
ment, the  apex  tie  releases,  followed  by  main  canopy  separation,  and  the 
drone  is  carried  by  the  load  line  supported  from  the  helicopter.  Figure  1 
shows  the  helicopter  and  parachute  system  just  prior  to  engagement. 

Safe  and  consistent  MARS  operations  depend  on  the  pilot's  ability  to 
match  the  helicopter's  vertical  velocity  with  the  parachute's  while  closing 
with  the  top  of  the  engagement  parachute.  At  the  same  time,  the  helicopter 
must  approach  from  a specific  direction  to  ensure  that  the  load  line  will  not 
be  pulled  through  the  main  canopy. 

The  pilot's  primary  visual  cue  is  the  alignment  of  the  helicopter,  the 
top  of  the  engagement  parachute,  and  the  horizon.  If  the  horizon  is  obscured 
by  smoke,  haze,  or  clouds,  or  if  false  horizons  are  present,  the  pilot  has 
extreme  difficulty  in  Judging  his  position  relative  to  the  target.  Under 
these  circumstances,  attempted  recovery  can  be  dangerous  and  fruitless. 

Variations  in  the  size  of  the  parachute  canopies  can  produce  illusions 
of  being  too  high  or  too  low  relative  to  the  engagement  parachute.  The  pilot 
must  allow  the  canopy  top  to  pass  beneath  the  fuselage  as  the  helicopter 
closes  with  the  engagement  parachute.  The  apparent  change  in  position  from 
level  to  approximately  twelve  feet  below  the  helicopter  can  make  engagement 
difficult  to  judge.  These  visual  problems  are  compounded  by  the  need  for 
precise  heading  and  roll  control  since  any  degree  of  uncoordinated  flight  is 
magnified  in  the  pole  position.  Airspeed  must  be  maintained  within  a small 
band  (43  to  60  knots)  for  proper  operation  of  the  energy  absorbing  winch. 

The  head-up  display  has  been  used  to  assist  pilots  during  visual  track- 
ing tasks.  The  HUD  is  an  outgrowth  of  the  reflecting  gunsight  and  presents 
flight  instrument  data  in  the  pilot's  field  of  view  as  he  looks  at  external 
visual  cues.  To  date,  HUDs  have  been  applied  to  two  main  areas:  weapons 
delivery(J^)  and  landing  approach (^,2) . A survey  of  HUD  technology  is  also 
available (4) . 

HUDs  serve  to  combine  real  world  visual  cues  with  derived  data.  These 
data  sources  are  complementary.  It  would  be  difficult  to  reproduce  the  real 
world  cues  artificially.  At  the  same  time,  the  derived  data  presents  infor- 
mation that  the  pilot  cannot  perceive  directly,  or  only  with  great  difficulty. 
One  must  be  careful,  however,  to  ensure  that  both  data  fields  are  compatible. 
As  Singleton  points  out(2)«  there  is  a basic  incompatibility  between  the 
redundant,  analogue  data~of  the  real  world  and  the  symbolic,  often  digital 
data  of  artificial  displays.  The  problem  is  further  complicated  by  the  need 
for  careful  attention  to  retain  proper  balance,  so  that  the  proper  display 
(real  world  or  artificial  data)  dominates.  During  visual  tracking,  the  real 
world  must  dominate  with  the  flight  instrument  data  providing  supplementary 
information.  The  roles  reverse  during  instrument  flight.  However,  the  HUD 
must  not  be  such  a compelling  sight  that  the  pilot  fixates  on  it  to  the  ex- 
clusion of  the  real  world.  This  has  definite  implications  on  pilot  learning 
and  has  been  reported  elsewhere(2).  These  comments  were  verified  by  conversa- 
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tions  with  HUD-qualif led  pilots  prior  to  the  development  of  the  test  plan 
for  this  study,  as  well  as  during  preliminary  HUD  flights. 


EQUIPMENT  DESCRIPTION 


The  particular  HUD  evaluated  in  this  study  is  a modified  electro-mechan- 
ical unit  manufactured  by  Sundstrand  Data  Control.  The  system  consists  of 
two  pilot  display  units,  a control  module,  and  a computer.  The  HUD  was  de- 
velO).sd  from  a commercial  t-ansport  display  known  as  the  Visual  Approach 
Monitor  (VAM).  The  VAM  presents  pitch  and  longitudinal  flight  patch  infor- 
mation to  the  pilot.  No  roll  or  heading  information  is  supplied.  The  VAM 
was  designed  to  minimize  the  problems  of  judging  final  approach  path  angles 
during  visual  approaches.  It  is  presently  in  operational  use  with  Pacific 
Western  Airlines  in  their  arctic  support  flightsO)*  H has  also  been  eval- 
uated in  several  military  and  civilian  airplanes. 

Roll  information  is  not  considered  essential  since  the  VAM  was  designed 
for  use  on  final  approach  in  visual  conditions  only.  Later  VAMs  incorporate 
an  airspeed  index  showing  deviation  from  a reference  speed.  A color-coded 
index  shows  deviation  with  a red  S for  slow,  a yellow  F for  fast,  and  a green 
0 for  correct  airspeed.  This  peripheral  cue  is  similiar  to  the  angle-of- 
attack  indexes  on  some  military  airplanes. 

The  Light  Line  is  a further  development  of  the  basic  VAM  display.  De- 
veloped under  support  from  the  AFFOL,  the  Light  Line  presents  both  pitch  and 
roll  information  as  well  as  a flight  path  angle  display  appearing  as  a beam 
of  light  emanating  from  the  airplane  to  the  projected  impact  point.  This 
display  was  evaluated  as  an  approach  aid  in  USAF  T-38  airplanes  at  the  In- 
strument Flight  Center (^). 

The  HUD  used  in  this  study  is  a further  development  of  the  VAM/Light 
Line  displays.  At  the  start  of  the  proi^  am,  it  was  not  clear  if  roll-stabil- 
ization would  be  required.  Therefore  a roll/no-roll  option  was  provided 
through  a roll  cut-out  switch.  Airspeed  data  was  provided  with  a VAM-type 
airspeed  index,  and  a "ball  bank"  indicator  showed  sideslip  information. 
Figure  2 shows  the  symbology  of  the  test  M.".;S  HUD. 


SCOPE  OF  EXPERIMENT 


The  overall  purpose  of  this  program  was  to  determine  whether  a HUD  will 
assist  the  pilot  of  a MARS  helicopter  with  recoveries  in  low  visibility  con- 
ditions and  will  also  enhance  training  and  standardization.  The  experimen- 
tal objective  was  to  determine  whether  a no-roll  presentation  is  acceptable 
for  MARS  operations.  If  not,  is  a roll-stabilized  horizon  bar  acceptable? 
Specific  questions  to  be  answered  were:  (1)  What  changes  in  MARS  performance 
(precision  and  smoothness  of  control,  airspeed  control,  and  maintenance  of 
the  sight  picture)  are  attributed  to  the  HUD?  (2)  What  is  the  pilot  workload 
change  induced  by  the  HUD?  (3)  What  are  pilot  preferences  for,  and  potential 
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operational  problems  associated  with  roll-stabilized  and  non-roll-stabilized 
HUD  formats?  and  (4)  What  changes  in  HUD  format,  data,  or  procedures  will 
help  improve  MARS  performance? 

The  evaluation  was  originally  planned  to  be  conducted  in  two  phases,  both 
to  be  flown  from  Davis-Monthan  AFB,  Arizona,  in  visual  flight  conditions. 
Phase  I was  to  be  flown  using  80  lb  weights  with  modified  personnel  para- 
chutes (TWs)  as  targets.  Actual  engagement  was  not  planned.  A counterbal- 
anced experiment  was  designed  using  the  two  HUD  presentations  (roll-stabi- 
lized - RH,  and  no-roll  - NR)  and  a no  HUD  control  (NH).  The  experiment 
was  arranged  to  yield  useful  data  with  as  few  as  four  subjectsand  six  sorties, 
although  the  planned  numbers  were  six  subject  pilots  and  ten  sorties. 

Phase  II  was  to  follow  and  consist  of  two  MARS  recoveries  of  1800  lb 
dummy  vehicles  (DVs)  with  tandem  parachutes  (main  and  engagement  parachute 
system  described  above).  This  phase  was  intended  to  validate  the  results  of 
Phase  I which  used  single  parachutes  as  targets  with  no  recoveries.  During 
Phase  I,  the  advantages  of  the  HUD  were  so  obvious  that  Phase  I was  curtailed 
at  the  minimum  allowed  in  the  experimental  design.  Phase  II  was  expanded  to 
include  a thirty  day  operational  evaluation  at  an  operating  location  (OL). 
During  this  evaluation,  eighteen  operational  drones  were  recovered  using 
the  HUD. 


PHASE  I:  INITIAL  TESTING 


Each  subject  pilot  flow  on  one  or  two  sorties.  A sortie  consisted  of 
approximately  thirty  minutes  of  familiarization  with  the  HUD,  followed  by  up 
to  twelve  simulated  MARS  passes  to  TWs.  All  three  HUD  configurations  were 
used  on  a given  sortie:  RH,  NR,  and  NH.  The  order  was  varied  to  minimize  the 
effect  of  learning.  Each  subject  pilot  completed  a pre-experiment  question- 
naire, rating  cards  after  each  series  of  passes,  a post-flight  questionnaire, 
and  a post-experiment  questionnaire.  The  safety  pilot  completed  a rating 
card  after  each  pass. 

A total  of  six  sorties  were  flown  using  four  subject  pilots.  All  four 
subjects  were  well  qualified  in  CH-3  MARS  operations.  CH-3  flying  experience 
ranged  from  600  to  1800  hours  with  a total  flying  experience  range  of  2300 
to  2950  hours.  All  pilots  were  CH-3  instructor  pilots.  The  safety  pilots 
were  also  CH-3  instructor  pilots.  One  of  the  subjects  also  served  as  a safe- 
ty pilot  after  he  completed  his  flights  as  a subject.  None  of  the  pilots  had 
flown  any  HUD-equipped  aircraft  prior  to  this  evaluation. 

Pre-experiment  Questionnaire 

In  addition  to  establishing  the  subjects'  qualiMcations,  the  question- 
naire asked  for  their  assessment  of  the  MARS  mission.  Counting  the  safety 
pilot  and  the  copilut  on  otie  Phase  II  DU  recovery,  six  questionnaires  were 
completed.  The  consensus  was  that  the  most  significant  visual  problem  was 
determining  the  positior:  relative  to  the  engagement  parachute  in  the  absence 
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of  a natural  horizon.  The  pilots  also  commented  on  the  difficulty  of  transi- 
tioning from  keeping  the  parachute  on  the  horizon  to  passing  over  tT)e  canopy 
just  prior  to  engagement.  Two  pilots  felt  that  roll  information  would  be  very 
important  in  a MARS  HUD,  but  not  essential.  Three  felt  that  it  would  be 
desirable,  and  one  pilot  had  a neutral  opinion. 

Subjective  Workload 

There  was  no  major  change  in  overall  subjective  workload  as  reported  by 
the  pilots.  However,  sideslip  was  perceived  as  easier  to  control  with  either 
HUO  than  with  no  HUO.  Roll  was  reported  to  be  easier  with  the  RH  configura- 
tion than  with  the  NR  HUD.  Table  I shows  the  data. 

Need  for  Additional  Data 

Tlie  pilots  all  felt  a need  to  come  "inside"  for  more  data  than  was  shown 
on  the  HUD.  All  reported  a need  for  airspeed  until  they  adapted  to  the  air- 
speed indexes.  All  required  vertical  velocity  data.  Most  required  sideslip 
information  with  NH,  but  either  HUD  provided  this  data  to  the  pilots'  satis- 
faction. Roll  and  pitch  data  were  required  in  the  absence  of  a HUD  by  some 
pilots;  the  RH  configuration  eliminated  the  need  to  come  inside  for  either. 

One  pilot  felt  a need  for  torque  or  RPM. 

The  need  for  additional  data  is  summarized  in  Table  II.  The  HUD  was  felt 
to  be  useful  only  during  final  approaches  since  the  horizon  bar  was  displaced 
beyond  the  limits  of  the  combiner  glass  during  the  turns  to  final  approach. 

No  focus  or  visual  conflict  was  reported.  Two  pilots  reported  difficulty 
with  the  airspeed  cue.  Comments  were  also  made  about  the  HUD  blocking  the 
view  of  the  parachute  as  it  passed  beneath  the  helicopter. 

Performance 

Under  the  excellent  visibility  conditions  present  at  Davis-Monthan  AF8, 
there  was  no  difference  in  the  miss  rates  (reported  by  the  safety  pilot  or 
by  the  pole  operator)  between  the  RH  and  the  NH  configurations.  Both  had 
miss  rates  of  22%  (4  misses  in  IB  passes).  The  absence  of  roll  data  causes 
the  miss  rate  to  increase  to  ZB%  <4  misses  in  14  passes).  This  is  not  statis- 
tically significant. 


Concern  Over  High  or  Low  Passes 

The  pilots  were  generally  less  concerned  over  high  or  low  passes  with  the 
HU)  than  without.  One  pilot  commented  that  while  he  was  less  concerned  in 
general,  the  loss  of  sight  of  the  parachute  on  short  final  (blocked  by  the  HUO 
hardware)  did  bother  him.  (Note:  this  subject  pilot  also  flew  as  a safety 
pilot  and  as  a subject  pilot  during  Phase  II  and  felt  that  it  was  not  a prob- 
lem after  adaptation.)  Cither  HUD  configuration  caused  the  "hits"  to  be  con- 
centrated at  the  pole  tips. 
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other  Comments 


Additional  comments  were  made.  Significant  coimnents  (paraphrased)  are: 

(1)  Airspeed  too  far  from  center  (3  subjects),  (2)  Display  should  be  moved 
closer  to  pilot  (3  subjects),  (3)  HUD  would  help  training  by  providing  a com- 
mon sight  picture  to  instructor  and  student  (3  subjects),  (4)  Practice  time 
was  too  limited  (3  subjects)  and  the  learning  curve  was  slow  for  airspeed  con- 
trol (1  subject),  and  (5)  The  horizon  line  should  be  made  more  intense  than 
the  aiming  V (1  subject), 

PHASE  II:  OPERATIONAL  EVALUATION 

following  the  decision  to  conduct  an  operational  evaluation  at  t(«  OL, 
the  two  pilots  chosen  to  fly  the  evaluation  each  flew  a training  sorties  con- 
sisting of  practice  MARS  approaches  to  two  TWs,  followed  by  a sorties  with  an 
actual  recovery  of  an  1800  lb  DV.  The  two  pilots  were  already  experienced  with 
the  HUD,  having  flown  as  safety  pilots  in  Phase  I (one  also  flew  as  the  first 
subject ) . 

The  HUD  was  removed  from  the  helicopter  used  for  Phase  I and  for  the  four 
sorties  described  above.  It  was  then  taken  to  the  OL  and  installed  in  another 
CH-3.  Eighteen  operational  recoveries  were  made  at  the  OL  during  the  month  of 
April  1975.  Only  the  RH  display  was  used  for  recoveries  during  this  phase,  al- 
though the  NR  mode  was  briefly  evaluated  during  other  flying  in  the  haze  con- 
ditions prevalent  at  the  OL. 

Both  DV  recoveries  at  Oavis-Honthan  AFB  were  made  on  the  first  pass.  Of 
the  eighteen  HUD-assisted  engagements  at  the  OL,  sixteen  were  made  on  the 
first  pass*,  one  on  the  second,  and  one  on  the  third  pass.  Oie  missior>  had  a 
no-HUD  recovery  (4th  pass)  because  of  excessive  display  vibration*  The  miss 
rate  using  the  HUD  was  14?i  (per  pass). 

Benefit  of  HUD 

The  second  operational  sortie  typifies  the  benefit  of  the  HIO.  On  this 
sortie,  the  load  line  break-ties  had  separated  from  the  main  canopy  resulting 
in  the  engagement  parachute  lying  over  and  remaining  at  the  same  altitude  as 
the  main  canopy.  With  the  horizon  obscured  by  haze,  rain,  and  clouds,  the  HUD 
allowed  a successful  recovery  on  the  first  pass.  The  pilots  felt  that  in  the 
absence  of  a HUD,  there  would  have  been  multiple  missed  passes  and  very  likely 
a lost  drone. 

The  pilots  felt  that  pilot  workload  was  much  lower  with  the  HU). 

Visual  Illusions 

Both  pilots  commented  on  an  illusion  during  passes  with  the  HUD  in  mar- 
ginal weather.  They  had  the  illusion  of  being  correctly  lined  up  with  the 
engagement  parachute,  but  the  HUD  showed  them  to  be  high.  Confidence  in  the 


Counting  one  tear-out  as  a successful  pass 
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HUD  from  their  experience  in  Arizona  allowed  them  to  use  the  Hlfl)  to  correct 
their  flight  paths  and  make  consistent  catches. 

Need  for  Roll-Stabilization 

The  HUD  proved  to  be  highly  satisfactory  under  adverse  weather  conditions 
with  roll-stabilization;  but  without  roll  a serious  problem  was  encountered. 
Both  pilots  felt  that  manuevering  in  haze  induced  vertigo.  They  considered 
that  roll -stabilization  was  an  essential  requirement  for  use  in  reduced  visi- 
bility. 


DISCUSSION 


Operational  Effectiveness 

There  were  77  MARS  passes  during  the  evaluation.  Of  these,  fifty  passes 
were  made  to  80  lb  TWs  and  success/failure  was  estimated  by  the  safety  pilot 
or  pole  operator.  The  remaining  27  passes  were  made  to  DVs  or  to  actual 
drones  with  success  being  defined  as  an  engagement  (or  a tear-out).  Of  the 
77  total  passes,  twenty-five  were  made  during  drone  recoveries  in  haze  at  the 
OL.  The  remaining  passes  (30  TWs  and  2 DVs)  were  made  in  good  weather  in 
Arizona. 

We  must  further  separate  the  data  into  learning  and  steady-state  perform- 
ance. To  do  this,  we  shall  classify  all  no-HUO  passes  as  steady-state  since 
all  subjects  were  considered  to  be  highly  qualified  by  their  organizations. 

All  Phase  I passes  with  either  HLK)  should  be  considered  as  learning  passes. 

The  actual  recoveries  made  using  the  roll-stabilized  HUD,  both  DVs  and  opera- 
tional drones,  can  be  classed  as  steady-state  performance.  Thus  we  have  32 
learning  passes  and  43  steady-state  performance  passes. 

The  performance  comparison  between  the  two  HUD  versions  can  only  be  based 
on  the  learning  data.  Because  of  the  small  sample  size,  the  difference  in 
miss  rates  is  not  significant. 

To  compare  the  performance  of  the  RH  and  the  no-HUD  baseline,  we  must  use 
steady-state  performance  and,  as  a result,  equate  the  difficulty  of  making 
passes  to  TWs  and  to  tandem  parachutes,  although  the  motion  of  the  tandem 
parachute  system  makes  actual  recoveries  harder.  Likewise,  we  must  equate  the 
difficulty  of  operating  in  Arizona  in  good  visibility  to  the  difficulty  of 
operating  at  the  OL  in  haze  and  smoke.  Since  the  NH  passes  were  mostly  made 
to  TWs  at  Davis-Monthan  AFD,  these  assumptions  are  heavily  weighted  against 
the  HUD. 

Nevertheless,  the  miss  rates  were  much  lower  with  tTw  HUD  (3  misses  in 
23  pusses  or  13?i)  than  wittiout  the  HUD  (32%  missed).  Again  the  limited  data 
precludes  ai^y  statistical  test  (x*=2.29,  dfrl,  0.2>p>0.1).  However,  in  view 
of  the  heavily  biassed  test  conditions,  this  difference  in  miss  rates  should 
be  considered  valid. 
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Mission  Success  Rate 


To  convert  from  miss  rate  (i.  e.,  fraction  of  passes  missed)  to  mission 
success  rate  (i.  e.,  fraction  of  drones  recovered),  we  use  the  familiar  par- 
allel redundancy  formula: 

MISSION  SUCCESS  RATE  = 1 - (MISS  RATE)" 

M/here  n is  the  number  of  passes  possible  before  the  drone  is  too  low  for  a 
safe  pass.  With  a typical  value  of  n = 3,  we  can  compute  the  mission  success 
rates.  For  the  roll  HUD,  the  learning  curve  performance  is  98.9?o  and  the 
steady-state  performance  in  99.8?o  of  all  drones  recovered.  The  steady-state 
baseline  (no  HUD)  performance  is  96.8?o. 

Again,  the  assumptions  favor  the  no  HUD  case.  If  we  look  at  the  one 
sortie  where  the  HUD  malfunctioned  (3  misses  out  of  four  passes),  the  corres- 
ponding mission  success  rate  for  no  HUD  in  haze  would  be  58?o.  This  figure 
is  consistent  with  mission  recovery  rates  of  less  than  fifty  percent  which 
have  been  reported  in  no-horizon  conditions. 

Flight  Safety 

The  primary  hazard  during  MARS  operations  is  collision  with  the  para- 
chute. During  Phase  I,  it  was  noticed  that  the  successful  passes  with  the  HUD 
were  concentrated  at  the  pole  tips.  This  effect  is  probably  the  result  of  the 
aiming  \t  helping  the  pilot  to  make  a smooth  transition  to  allow  the  parachute 
to  pass  beneath  the  helicopter  into  the  engagement  window.  While  this  effect 
was  only  noticed  with  passes  to  TWs,  it  will  undoubtedly  reduce  the  number  of 
nose  or  belly  slaps  during  training  and  certainly  minimize  the  risk  of  a ca- 
tastrophic collision.  It  is  not  clear  whether  the  aiming  V should  be  adjus- 
table to  accommodiate  different  size  parachutes.  The  pilot  opinions  were 
divided  and  no  tests  were  conducted. 

While  no  particular  problems  with  the  no-roll  HUD  were  noted  during 
flights  in  good  weather,  the  pilots  at  the  OL  did  report  a strong  tendency 
toward  vertigo  when  flying  the  no-roll  HUD  in  restricted  visibility.  This 
represents  an  unacceptable  hazard. 

One  sortie  was  cancelled  because  of  invalid  pitch  data  on  one  HUD.  This 
can  be  a serious  hazard  in  instrument  weather  conditions  or  if  the  horizon  is 
not  visible.  Serious  consideration  should  be  given  to  incorporating  an  in- 
strument comparator  to  warn  against  invalid  data.  Failing  this,  crew  proce- 
dures must  be  developed  to  ensure  that  discrepancies  are  noted.  However,  it 
will  be  difficult  for  the  non-flying  pilot  to  crosscheck  his  HUD  with  his 
panel  instruments. 


Displayed  Data  Requirements 

The  basic  MARS  HUD  was  intended  to  display  pitch,  sideslip,  and  airspeed 
with  an  optional  roll  display.  The  pitch  display  was  the  primary  display 
needed  for  MARS.  Since  sideslip  and  airspeed  were  critical  for  successful 
engagements,  they  were  also  included.  Part  of  the  experimental  design  was  to 
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evaluate  the  need  for  roll.  The  HUD  also  included  an  aiming  \1  to  assist  the 

pilot  during  the  transition  just  prior  to  engagement.  During  the  evaluation, 

pilot  comments  suggested  that  vertical  velocity  data  be  added. 

Pitch.  Lack  of  adequate  pitch  cues  from  the  horizon  \i/as  the  original 
reason  for  the  HUD.  We  can,  therefore,  presume  that  pitch  is  a requirement 
for  a MARS  HUD.  However,  with  a pitch  malfunction,  the  airspeed,  sideslip, 

and  vertical  velocity  data  would  still  be  useful.  Pitch  failure,  then,  need 

only  extinguish  the  pitch  and  roll  displays  (and  the  aiming  \1). 

Roll.  Roll  can  be  considered  a requirement  primarily  as  a vertigo 
avoiding  measure.  Roll  failure  must  extinguish  the  pitch  and  roll  displays. 

Airspeed.  No  test  without  airspeed  was  conducted.  We  conclude  from 
pilot  comments  that  it  is  required.  Airspeed  failure  need  only  extinguish 
the  speed  indexes. 

While  the  use  of  the  three  symbol  airspeed  display  is  adequate  for  de- 
termining both  the  actual  airspeed  and  trends,  some  learning  over  and  above 
the  normal  HUD  familiarization  seems  to  be  needed. 

Sideslip.  Likewise,  no  specific  evaluation  of  a no-sideslip  HUD  was 
done.  Based  on  pilot  comments,  we  conclude  that  it  is  a requirement.  The 
original  ball  bank  display  was  too  hard  to  read  for  small  sideslip  angles. 

As  a result,  the  opaque  ball  was  changed  to  a triangular  shaped  sideslip  in- 
dex. The  display,  as  modified,  is  adequate  for  the  MARS  mission.  Bad  side- 
slip data  need  only  extinguish  the  ball  bank  display. 

Vertical  Velocity.  The  original  display  had  no  vertical  velocity  data. 
However,  the  majority  of  the  pilot  comments  indicated  a need  for  such  data. 

The  reason  for  this  can  be  found  in  the  Air  Force  handbook  on  instrument  fly- 
ing(2)»  This  approach  divides  the  flight  instruments  into  control  and  per- 
formance instruments.  The  pilot  makes  his  control  inputs  be  reference  to  the 
control  instruments  (such  as  ADI  or  power/thrust)  and  monitors  the  aircraft's 
response  by  reference  to  the  performance  instruments  (airspeed,  heading,  or 
vertical  velocity). 

The  MARS  pilots,  having  made  a pitch  or  power  correction  to  fly  up  or 
down  relative  to  the  parachute,  felt  the  absence  of  a vertical  performance 
instrument  to  monitor  their  corrections.  This  explains  the  need  for  vertical 
velocity  data.  Apparently,  they  felt  able  to  do  without  a power  control  in- 
strument. Perhaps,  kinesthetic  feedback  from  the  collective  position  was 
sufficient.  One  pilot  did  comment  on  the  absence  of  torque  or  RPM  data. 

During  the  recovery  after  engagement,  the  pilot  must,  at  maximum  torque, 
trade  altitude  for  airspeed.  During  this  transition,  the  vertical  velocity 
data  is  also  needed.  A torque  display  is  not  needed  since  the  pilot  can  sense 
maximum  torque  from  the  RPM  droop.  As  a result  of  these  observations,  the 
production  MARS  HUD  incorporates  a vertical  velocity  display.  Preliminary 
pilot  comments  to  this  addition  were  favorable. 
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Aiming  V.  The  aiming  V vi/as  commented  on  favorably  by  the  subject  pilots. 
However,  no  concensus  could  be  reached  on  the  need  for  different  Vs  for  dif- 
ferent sized  parachute  canopies. 

Modified  Display.  As  a result  of  the  testing  and  pilot  comments,  the 
symbology  was  changed  for  the  production  MARS  HUD  hardware.  The  revised 
format  it  shown  in  Figure  3. 


CONCLUSIONS 


The  HUD  system  (with  roll)  will  enhance  MARS  performance  during  periods 
of  reduced  visibility.  It  will  also  enhance  safety  during  training  by  causing 
the  passes  above  the  target  parachute  to  be  higher  — reducing  the  chances  of 
the  helicopter's  striking  the  parachute.  Roll  stabilization  is  a safety-of- 
f light  requirement  to  avoid  vertigo  in  no-horizon  weather  conditions.  Roll- 
stabilization  appeared  to  improve  performance  over  the  no-roll  case;  however 
insuffient  data  was  available  for  a statistically  valid  test. 

Pilot  workload  is  much  lower  when  using  the  HUD.  Training  to  use  the  HUD 
should  require  practice  passes  to  2-4  training  weights,  assuming  a MARS-quali- 
fied  pilot.  The  ability  to  make  full  use  of  the  airspeed  cue  on  the  HUD  may 
require  additional  time.  The  airspeed  learning  curve  seems  to  be  quite  var- 
iable from  pilot  to  pilot. 

The  MARS  HUD  should  display  pitch,  roll,  sideslip,  airspeed,  and  vertical 
velocity  data.  A reliable  self-test  circuit  is  highly  desirable.  The  horizon 
line  should  be  more  distinct  than  the  aiming  V. 

While  the  HUD  should  enhance  crew  training  and  standardization  as  well  as 
mission  performance,  operational  flight  procedures  should  be  reviewed  shortly 
after  fleet  use  begins. 
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Figure  2 

MARS  HUO  Display  Format 
(As  Tested) 


Figure  3 

Revised  Display  Format 
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ABSTRACT 


The  effects  of  display  and  control  parameters  on  approach 
performance  of  a simulated  Terminal  Configured  Vehicle  (TCV)  were 
explored  experimentally  in  a manned  simulation  study  and  analyti- 
cally using  a state-of-the-art  oilot/vehicle  model.  A revised 
treatment  of  nonrandom  inputs  was  incorporated  in  the  model.  Res- 
ponse behavior  was  observed  for  two  display  configurations  (a 
pictorial  EADI  presentation  and  a flight-director  configuration 
requiring  use  of  a panel-mounted  airspeed  indicator) , two  control 
configurations  (attitude  and  velocity  control  v;heel  steering)  , 
and  two  shear  environments,  each  of  which  contained  a head-to-tail 
shear  and  a vertical  component. 

In  general,  performance  trends  predicted  bv  the  model  were 
confirmed  experimentally.  Experimental  and  analvtical  results 
both  indicated  superiority  of  the  EADI  display  with  respect  to 
regulation  of  height  and  airspeed  errors,  velocity  steering 
allowed  tighter  regulation  of  height  errors,  but  control  param- 
eters had  little  influence  on  airspeed  regulation.  Model  analysis 
indicated  that  display-related  differences  could  be  ascribed  to 
differences  in  the  quality  of  speed-related  information  provided 
by  the  two  displays. 


♦This  research  was  supported  by  the  National  Aeronautics  and 
Space  administration  under  contract  No.  NASl-13842. 


INTRODUCTION 


Hindshear  constitutes  one  of  the  major  threats  to  flight 
safety  in  approach  and  landing  operations.  This  threat  is  enhanced 
not  only  by  the  potential  severity  of  the  shear  (defined  as  a 
wind  whose  velocity  changes  with  altitude) , but  also  by  the  ten- 
dency of  the  shear  profile  to  change  rapidly  over  time.  This  lack 
of  predictability  has  led  to  the  need  for  control  and  display  aids 
to  help  pilots  better  cope  with  the  presence  of  windshears. 

This  paper  summarizes  the  second  phase  of  a program  to  analyze 
display-control  configurations  for  the  Terminal  Configured  Vehicle 
(TCV) . This  work  was  performed  for  NASA  Langley  Research  Center 
and  was  intended  to  augment  a simulation  study  conducted  there. 

The  first  phase  of  this  study  explored  the  effects  of  certain 
control  and  display  configurations  on  approach  performance  in  a 
zero-mean,  random  turbulence  environment.  The  LRC  simulation  was 
augmented  by  an  analytic  study  performed  at  Bolt  Beranek  and 
Newman  Inc.  using  the  "optimal-control"  pilot/vehicle  model  to 
explore  both  performance  and  workload  differences  among  control/ 
display  configurations  of  interest.  The  reader  is  assumed  to  be 
familiar  with  the  features  of  this  model,  which  has  been  well 
documented  in  the  literature.  Frequent  reference  is  made  below 
to  the  report  by  Levison  and  Baron  (11  which  documents  the  results 
of  the  first  study  phase  and  which  demonstrates  application  of  the 
pilot  model  to  analysis  of  TCV  anoroach  performance. 

Approach  performance  of  a TCV  in  windshear  environments  was 
studied  in  the  second  study  phase,  with  control  and  display  con- 
figuration (along  with  windshear  profile)  the  major  variables  of 
interest.  The  existing  pilot/vehicle  model  was  modified  to  allow 
a revised  treatment  of  nonrandom  inputs;  because  the  longitudinal 
and  vertical  components  of  the  shear  have  greatest  impact  on  path 
and  airspeed  regulation,  only  longitudinal-axis  performance  was 
explored  in  the  analytic  study.  The  results  of  the  windshear 
study  are  documented  in  [ 2 ) . 


PROBLEM  DEFINITION 


Description  of  the  Flight  Task 


The  flight  task  of  interest  was  the  standard  straight-in  (3 
degree)  approach  of  a simulated  TCV.  The  simulated  atmospheric 
environment  contained  low-level  zero-mean  gusts  plus  a wind  shear 
consisting  of  a rotating  horizontal  component  and  a brief  inter- 
lude of  either  an  updraft  or  a downdraft. 
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speed  and  flight  path  were  controlled  manually.  Plight-oath 
control  was  aided  by  one  of  the  following  control  augmentation 
schemes;  "Attitude  Control  Wheel  Steering  CACWS)  or  "Velocity 
Control  Wheel  Steering"  (VCWS) . Basically^  these  modes  provide 
attitude-rate  stabilization  and  allow  the  pilot,  in  effect,  to 
command  either  attitude  (ACWS)  or  path  angle  (VCWS) . A more 
detailed  description  of  control  wheel  steering  is  given  in  Levison 
and  Baron  tU . In  order  to  use  the  existing  man-machine  model, 
the  track-hold  feature  of  the  CWS  was  approximated  by  continuous 
linear  feedback  law  as  shown  in  Figure  1. 


Displays 

Flight  control  information  was  provided  primarily  by  an 
electronic  attitude/director  indicator  (EADI) . Two  display  con- 
figurations were  considered:  CD  "advanced"  display,  which  pre- 

sented information  in  an  integrated  (pictorial)  format,  and  (2) 
the  flight  director  display,  v/hich  provided  director  information 
based  on  path,  path  angle,  and  attitude  errors. 

The  advanced  display  provided  the  following  flight-control 
information  (as  diagrammed  in  Figure  2) : (a)  an  aircraft  symbol 

to  serve  as  x-axis  airframe  reference,  (b)  an  artificial  horizon 
and  pitch  attitude  scale,  (c)  a roll  attitude  scale  and  pointer, 

(d)  a pair  of  so-called  "gamma  wedges"  to  indicate  path  angle, 

(e)  a dashed  line  to  indicate  a point  3 degrees  below  the  horizon, 

(f)  a perspective  runway  symbol,  (g)  an  extended  runway  center 
line  to  aid  in  lineup  regulation,  (h)  a symbol  to  indicate  track 
angle,  (i)  a glideslope  indicator,  (j)  a localizer  indicator,  and 
(k)  a so-called  "potential  gamma"  symbol  to  provide  information 
pertaining  to  speed  management. 

Except  for  the  potential  gamma  symbol,  this  display  was 
indentical  to  the  advanced  display  described  in  (IJ , to  which  the 
reader  is  referred  for  additional  details  on  the  structure  and 
use  of  this  display.  A weighted  sum  of  airspeed  error  and  rate  of 
change  of  vehicle  velocity  was  used  to  drive  the  potential  gamma 
symbol,  relative  to  the  gamma  wedge,  in  the  vertical  dimension. 

The  "flight  director  display"  consisted  of  a raw  status  dis- 
play plus  director  information.  The  EADI  provided  attitude  infor- 
mation, glideslope  and  localizer  errors  in  symbolic  format,  and 
director  information.  Airspeed  and  rate-of-climb  were  displayed  by 
conventional  panel  meters.  Perspective  runway,  gamma  wedges,  and 
potential  gamma  were  omitted  from  the  EADI  in  this  display  con- 
figuration. 

Director  information  was  provided  with  a pair  of  crossbars 
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Figure  2.  Sketch  of  the  EADI  Display 

(Di&’>play  elements  defined  in  the  text) 
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that  deviated  from  the  x-axis  reference  symbol  in  a "fly-to"  mode. 
The  director  indicator  was  driven  by  a weighted  sum  of  height, 
path  angle,  and  pitch-rate  errors  as  described  in  [2}. 


Wind  Environment 


Wind  shears  as  well  as  sero-mean  random  gusts  were  simulated 
in  the  NASA-LRC  experiments.  In  order  to  simplify  problem  for- 
mulation and  reduce  computational  requireiiients,  the  effects  of 
these  simulated  gusts  were  approximated  in  the  bulk  of  the  model 
analysis  by  including  wide-band  disturbances  added  in  parallel 
with  the  control  deflections.  Preliminary  model  analysis  was 
conducted  to  select  disturbance  levels  that  would  give  nearly  the 
same  predicted  path  and  airspeed  errors  as  would  be  obtained  from 
a more  faithful  representation  of  the  simulated  gust  inputs  [2] . 

Each  of  the  simulated  windshears  used  in  the  experimental 
and  analytical  study  contained  a rotating  horizontal  component 
plus  a brief  vertical  component.  Figure  3 shows  the  relationship 
between  wind  speed  and  range  for  points  along  the  nominal  3 degree 
glide  path  for  two  of  these  shears.*  (Note  that  the  horizontal 
and  vertical  wind  components  have  been  scaled  differently  in  this 
figure. ) 


METHODS 


Model  Analysis 


The  model  employed  in  this  study  was  basically  the  so-called 
"optimal-control  model"  described  extensively  in  the  literature, 
modified  to  treat  non-zero-mean  (i.e.,  deterministic)  inputs.  As 
the  treatment  of  the  deterministic  input  (i.e.,  the  windshear) 
was  different  from  that  used  in  previous  studies  (3-5),  a brief 
discussion  of  this  treatment  is  given  below.  A more  detailed 
exposition  of  this  aspect  of  the  pilot  model  is  given  in  the  ap- 
pendix to  (21. 

Modeling  the  pilot's  response  to  a deterministic  input  in- 
volves two  basic  considerations:  (1)  the  degree  to  which  the 


*Since  windspeed  is  an  explicit  function  of  altitude,  rather  than 
range,  deviation  of  the  aircraft  from  the  desired  glide  oath 
would  modify  somewhat  the  range  dependency  shown  in  Figure  3. 
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Figure  3.  Windshear  Profile 
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pilot  understands  the  nature  of  the  input  (i.e.,  his  ''internal 
model"),  and  (2)  the  way  in  which  the  pilot  detects  and  responds 
to  the  input.  A simple  representation  of  the  pilot's  knowledge  of 
the  windshear  was  adopted  for  the  study;  basically,  we  assumed  no 
specific  knowledge  of  the  shear,  only  the  knowledge  that  a non- 
zero-mean wind  might  exist.  We  assumed  that  the  pilot  would  not 
gry  to  anticipate  changes  in  the  wind,  but  would,  at  best,  attempt 
to  estimate  the  current  wind  vector.  This  level  of  pilot  knowl- 
edge was  modeled  by  simply  implementing  a stepwise-constant  repre- 
sentation of  the  wind.  Since  the  wind  varied  relatively  slowly 
with  time,  an  integration  time  step  of  1 second  was  sufficiently 
fine  to  allow  an  adequate  representation  of  the  continuously- 
varying  wind  speed. 

The  pilot/vehicle  model  was  modified  to  reflect  the  following 
assumptions  concerning  pilot  behavior  in  a non-zero-mean  input 
environment: 

a.  The  pilot  continuously  anticipates  the  behavior  of 
the  display  variables  he  is  utilizing,  given  his 
current  estimates  of  system  states  and  his  internal 
model  of  system  parameters. 

b.  The  pilot  performs  a short-term  average  on  the 
difference  between  expected  and  actual  behavior 
of  each  display  variable. 

c.  If  average  prediction  error  is  sufficiently  large 
with  respect  to  the  variability  of  this  error, 
the  pilot  becomes  additionally  uncertain  about 
his  estimates  of  system  state  variables,  and  he 
attempts  to  upgrade  these  estimates. 

Implementing  this  set  of  assumptions  led  to  the  following 
additional  pilot-related  model  parameters:  (1)  the  short-term 

averaging  time,  (2)  the  magnitude  of  the  prediction  error  con- 
sidered large  enough  to  warrant  special  action,  and  (3)  specific 
state  variables  to  which  the  pilot  attributes  his  uncertainty. 

In  addition,  an  algorithm  had  to  be  formulated  for  relating 
prediction  errors  to  increased  uncertainty. 

Model  predictions  were  obtained  with  the  assumptions  that 
(1)  prediction  errors  were  averaged  over  about  two  seconds,  (2) 
an  average,  deviation  of  two  standard  deviations  from  the  expected 
’•alue  warranted  special  consideration  by  the  pilot,  and  (3)  uncer- 
tainty could  be  associated  with  any  of  the  oi'incipal  state  vari- 
ables, including  the  state  variables  representing  the  horizontal 
and  vertical  shear  components. 
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To  obtain  a model  solution  it  was  necessary  to  describe  the 
task  environment  in  a suitable  mathematical  format  and  to  assign 
values  to  model  parameters  related  to  pilot  limitations.  System 
dynamics  were  modeled  as  described  in  [1] , with  the  modification 
indicated  in  Figure  1 of  this  paper  to  account  for  control  wheel 
steering  augmentation. 

The  pilot  was  assumed  to  adopt  a control  strategy  that  mini- 
mizes a weighted  sum  of  mean-squared  response  variables.  In 
this  study,  the  "cost  function"  included  height  error,  sinkrate 
error,  airspeed  error,  angle-of-attack  error,  control  deflection, 
and  rate-of-change  of  control  deflection.  Because  the  results 
of  the  previous  study  suggested  that  pilots  tended  to  regulate 
height  error  in  terms  of  an  angular,  rather  than  a linear,  cir- 
terion,  weightings  associated  with  height  and  sinkrate  errors 
were  varied  inversely  with  range.  Weightings  for  other  variables 
were  kept  fixed  throughout  the  "flight"  as  documented  in  [2] . 

When  tracking  with  the  advanced  display,  the  pilot  was  as- 
sumed to  perceive  height  error,  sinkrate  error,  pitch  and  pitch 
rate,  flight  path  angle  and  path  angle  rate,  and  potential  gamma. 
Because  movement  of  the  perspective  runway  with  respect  to  the 
nominal  glideslope  was  proportional  to  error  in  angular  terms, 
the  thresholds  for  height  and  sinkrate  errors  (in  terms  of  feet 
and  ft/sec)  varied  linearly  with  range.  The  height  error  thres- 
hold was  based  on  an  "indifference  threshold"  of  1.4  meters  at 
the  30  meter  decision  height  as  determined  from  previous  analysis. 
Other  threshold  values  were  based  on  considerations  of  visual 
resolution  as  described  in  Levison  and  Baron.  The  noise/signal 
ratio  of  -17  dB  associated  with  use  of  the  advanced  display 
reflects  a moderate-to-high  level  of  workloact  with  no  interference 
among  display  elements  (i.e.,  we  assume  integration  of  the  dis- 
played information) . 

When  tracking  with  the  director  display,  the  pilot  was 
assumed  to  rely  primarily  on  the  director  symbol  and  the  air- 
speed indicator  for  continuous  flight-control  information,  with 
a negligible  amount  of  time  spent  scanning  the  status  informa- 
tion for  monitoring  purposes  only.  The  threshold  of  1.0  m/sec. 
on  airspeed  was  based  on  the  assumption  that  the  pilot  was  in- 
different to  airspeed  errors  smaller  than  the  calibration  incre- 
ments of  the  airspeed  indicator  (2  kts) : threshold  values  for 
perception  of  director  displacement  and  rate  were  based  on  visual 
resolution  limitations.  The  noise/signal  level  of  -14  dB  reflects 
the  same  overall  level  of  attention  to  the  task  as  before,  with 
the  requirement  to  share  attention  between  the  director  and  air- 
speed indicators.  For  simplicity,  equal  sharing  of  attention 
between  the  two  displays  was  assumed,  and  loss  of  visual  inputs 
associated  with  eye  movements  was  neglected. 
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Experimental  Procedures 


The  experimental  task  was  to  track  a 3®  ILS  beam  to  touch- 
down. Each  experimental  trial  began  at  a simulated  range  of  G700 
m from  the  runway  threshold  at  an  altitude  of  approximately  366  m. 
The  aircraft  was  initially  trimmed  on  the  desired  glide  path  for 
a 3®  path  angle  in  its  approach  configuration:  120-knot  airspeed 

laps,  gear  down.  Rudder  was  automatically  controlled. 

Zero-mean  random  gusts  and  wind  shears  were  both  simulated 
during  each  experimental  trial.  Three  shear  environments  were 
explored,  including  those  designated  as  "Shear  1"  and  "Shear  3", 
profiles  of  which  are  given  in  Figure  3. 

Gust  disturbances  having  an  rms  variation  of  0.3m/sec  were 
simulated  for  all  three  translational  axes.  Gust  spectral  char- 
acteristics were  varied  with  altitude  according  to  the  wind  models 
suggested  by  Chalk  et  al.  [6]. 

Data  were  obtained  from  three  NASA  test  pilots.  Practice 
trials  were  provided  using  shears  other  than  those  specified  for 
data  collection.  Each  pilot  "flew"  two  sessions  of  18  approaches 
each  for  data  collection;  each  session  consisted  of  two  replica- 
tions of  3 control/display  configurations  and  3 shear  environments 
presented  in  a balanced  order.  Thus,  four  replications  per  experi- 
mental condition  per  pilot  were  obtained. 

Ensemble  statistics  were  computed  for  selected  response 
variables  for  each  experimental  condition.  First,  wi thin-subject 
replications  were  analyzed  to  provide  trajectories  of  mean  response 
and  of  the  standard  deviation  of  the  response.  These  measures 
were  processed  further  to  provide  across-subject  averages  of  the 
mean  and  standard-deviation  response  trajectories.  Mathematiccxl 
definitions  of  these  statistical  variables  are  given  in  Levison 
and  Baron. 

For  purposes  of  data  presentation,  statistical  analysis  was 
performed  for  height  and  airspeed  errors,  sampled  at  305  meter 
intervals  beginning  at  a range  of  4572  m from  the  ILS  origin. 


SUMMARY  OF  RESULTS 


Considerations  of  space  preclude  an  extensive  presentation 
of  either  theoretical  or  experimental  results.  A sampling  of 
results  is  presented  to  demonstrate  three  applications  of  the 
pilot/vehicle  model  in  the  context  of  this  study:  (1)  prediction, 
(2)  diagnosis,  and  (3)  extrapolation.  Additional  results  are 
documented  in  [2] . 
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Prediction 


The  following  four  figures  compare  display  and  control  trends 
for  predicted  and  experimental  mean  response  trajectories  for  the 
"Shear  1"  environment.*  Because  the  experiment  was  not  full 
factorial,  display  differences  ara  shewn  for  the  Attitude  CWS 
configuration  only,  and  control  differences  are  compared  for  the 
advanced  display  cenf iguiaLxon. 

Effects  of  display  on  mean  height  error  and  mean  airspeed 
error  are  shown,  respectively,  in  Figures  4 and  5.  In  general, 
the  trends  predicted  by  the  model  are  confirmed,  but  the  differ- 
ences observed  experimentally  aie  smaller  than  predicted.  Model 
and  experimental  correlation  is  generally  better  for  height  than 
for  speed  response. 

As  predicted,  experimental  height  error  is  generally  more 
negative  for  the  director  than  for  the  advanced  display.  The  data 
also  confirm  the  prediction  that  the  director  display  leads  to 
a larger  swing  in  error  over  the  course  of  the  approach.  There 
was  also  a tendency  (not  predicted)  for  the  pilots  to  fly  above 
the  nominal  glide  path. 

Figure  5 shows  that  the  test  pilots  flew  the  director  dis- 
play v/ith  less  negative  (or  more  positive)  airspeed  errors  than 
achieved  for  the  advanced  display — a trend  the  reverse  of  which 
was  predicted  by  the  model.  Given  the  reported  tendency  of  pilots 
to  fiy  approach  speeds  greater  than  nominal  when  windshears  are 
anticipated  [7] , we  suspect  that  the  test  subjects  attempted  to 
compensate  for  the  lack  of  good  airspeed  information  from  the 
director  configuration  by  intentionally  carrying  excess  airspeed. 
Experimental  results  confirm  the  prediction  of  greater  swings  in 
error  with  the  director  display,  although  the  magnitudes  of  the 
display-related  differences  are  less  than  predicted. 

Figures  6 and  7 confirm  the  major  trends  predicted  for  con- 
trol effects;  namely,  tighter  regulation  of  height  error  was 
observed  for  velocity  Cws,  whereas  control  configuration  had  little 
effect  on  regulation  of  speed  error. 

Results  for  the  Shear  3 environment,  documented  in  (2) , showed 
similar  types  of  correlation  between  predicted  and  measured  mean 
error  trajectories. 


*Model  results  shown  in  these  figures  are  true  predictions  in 
the  sense  that  they  were  obtained  before  the  experimental  data 
were  analyzed.  Pilot-related  model  parameters  were  not  adjusted 
to  provide  a best  match  to  the  data. 
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Figure  4.  Effect  of  Display  on  Mean  Height  Error,  Shear  1 
Attitude  CWS. 

A = advanced  display,  F = flight  director 
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Figure  5.  Effect  of  Display  on  Mean  Airspeed  Error, 
Shear  1 

Attitude  CWS. 

A = advanced  display,  P = flight  director 
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Figure  7.  Effect  of  CWS  on  Mean  Airspeed  Error,  Shear  1 
Advanced  display. 

A = attitude  CWS  V = velocity  CWS 
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Diagnosis 


In  order  to  ascertain  the  cause  of  the  perfoxrmance  differences 
observed  for  the  two  display  configurations,  the  director  display 
configuration  was  reanalyzed  with  the  threshold  of  0.024  m/sec 
(as  opposed  to  1.0  in/sec  assumed  previously).  This  reduced  thresh- 
hold  was  equivalent  to  that  which  would  be  associated  with  the 
potential  gamma  indicator  of  the  advanced  display  if  potential 
gamma  were  driven  solely  by  airspeed  error.  Director  laws  and 
scaling  were  unchanged,  and,  as  before,  the  pilot  was  assumed  to 
share  attention  equally  between  the  director  and  speed  indicators. 

Figure  8 shows  that  predicted  performance  with  the  director 
display,  given  improved  airspeed  resolution,  is  comparable  to  that 
achievable  with  the  advanced  display  for  the  Shear  1 environment. 
Thus,  reducing  the  perceptual  threshold  on  airspeed  should  sub- 
stantially improve  performance  with  the  flight  director.* 

Extrapolation 

A reliable  pilot/vehicle  model  provides  a convenient  tool  for 
answering  various  "what  if"  questions  that  may  not  be  readily 
explored  experimentally.  In  this  study  we  used  the  model  to  expl- 
ore the  consequences  of  providing  the  pilot  with  better  knowledge 
of  the  wind  environment.  Specifically,  the  "advanced"  display 
was  considered  with  additional,  direct,  displays  of  horizontal 
and  vertical  wind  assumed.  Thresholds  relating  to  perception  of 
wind  velocities  were  neglected,  and  an  integrated  display  was 
assumed  (i.e.,  noise/signal  ratios  remained  at  -17  dB  for  all  dis- 
play quantities) . The  intent  here  was  not  to  simulate  a physically 
realizable  display,  but  to  determine  the  performance  potential 
associated  with  improved  estimation  of  the  wind  environment. 

Figure  9 shows  that  predicted  performance  with  the  two  dis- 
plays is  nearly  identical  over  most  of  the  approach.  Thus,  it 
would  appear  that  little  overall  improvement  in  performance  can 
be  expected  from  a display  which  provides  the  pilot  with  improved 
estimates  of  the  instantaneous  wind  environment. 

This  latest  result  is  contingent  on  the  assumption  that  the 
pilot  does  not  attempt  to  estimate  the  altitude-  (hence,  time-) 
varying  nature  of  the  shear  but  attempts  only  to  estimate  the 
current  wind  vector.  It  is  possible  that  performance  could  be 
improved  if  the  pilot  were  to  attempt  to  extrapolate  the  wind — 


*As  of  the  writing  of  this  paper,  this  prediction  has  not  been 
tested  experimentally. 
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Figure  8.  Effect  of  Reduced  Threshold  for  Perception 
of  Airspeed  Error 

Shear  1,  attitude  CWS 

A « advanced  display,  F = flight  director, 

L = director  with  lowered  perceptual  threshold. 
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Figure  9.  Effect  of  Explicit  Display  of  Wind  on  Predicted 
Mean  Height  Error 

Attitude  CWS 

A - advanced  display,  W « additional  wind  display 


especially  if  the  display  were  augmented  to  provide  such  predictive 
information.  The  potential  for  predictive  capabilities  of  both 
pilot  and  display  is  a relevant  area  for  future  study. 


DISCUSSION 


In  general,  performance  trends  predicted  by  the  model  were 
confirmed  experimentally.  Experimental  and  analytical  results 
both  indicated  superiority  of  the  "advanced"  display  with  respect 
to  regulation  of  height  and  airspeed  errors.  Velocity  steering 
allowed  tighter  regulation  of  height  errors,  but  control  param- 
eters had  little  influence  on  airspeed  regulation.  Model  analysis 
indicated  that  display-related  differences  could  be  ascribed  to 
differences  in  the  quality  of  speed-related  information  provided 
by  the  two  displays. 

Predictions  were  most  accurate  with  regard  to  display-and 
control-related  differences  in  the  total  swing  of  the  mean  error 
over  the  course  of  the  approach,  and  least  accurate  with  regard  to 
response  variability  and  absolute  levels  of  mean  error.  Experi- 
mental run-to-run  variability  was  from  2 to  3 times  as  great  as 
predicted  for  both  height  and  speed  errors,  [2] , and  mean  errors 
tended  to  be  less  negative  (or  more  positive)  than  predicted. 

The  relatively  large  experimental  variability  may  have  been,  in 
part,  a result  of  keeping  the  data  base  small  to  prevent  the  pilot's 
learning  of  the  shear  profile.  In  addition,  there  appeared  to  be 
a tendency  for  the  pilots  to  fly  high  and/or  fast  on  some  trials 
and  not  on  others,  a factor  that  could  contribute  to  predictive 
inaccuracies. 

With  regard  to  future  application  of  the  pilot/vehicle  model 
to  tho  study  of  approach  performance  in  windshears,  one  might  pro- 
fitably address  questions  relating  both  the  pilot's  conception  of 
the  behavior  of  the  wind  as  well  as  to  the  wind  information  expli- 
citly displayed.  For  example,  one  can  assume  that  the  pilot  knows 
that  the  wind  will  change  with  altitude  (and  thus  with  time)  in 
a smooth  manner,  and  one  can  explore  the  consequences  of  displaying 
(a)  the  same  variables  displayed  in  this  study,  (b)  additional 
variables  relating  to  the  current  wind  state,  and  (c)  additional 
variables  relating  to  the  rate-of-change  of  wind.  Furthermore, 
one  can  explore  the  interaction  of  these  factors  with  the  tyoe 
and  severity  of  shear.  Additional  factors  that  can  be  explored 
are  the  relation  between  performance  and  workload  for  candidate 
controls  and  displays,  as  well  as  the  utility  of  motion  cues  in 
detection  of  windshears. 

In  conclusion,  the  model  employed  in  this  study  has  been 
validated  with  regard  to  its  ability  to  predict  important  perform- 
ance trends  related  to  contro' s and  displays  in  windshear  environ- 
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roents.  Because  of  the  operational  necessity  of  understanding  per- 
formance in  windshears,  we  suggest  that  the  pilot/vehicle  model 
be  applied  further  to  aid  in  the  design  of  simulation  experiments 
and  to  explore  a variety  of  factors  that  cannot  be  readily  studied 
in  the  laboratory.  While  we  cannot  guarantee  accurate  predictions 
of  absolute  performance  levels  at  this  stage  of  model  development, 
the  model  should  provide  reliable  indications  of  the  nature  of 
performance  and  workload  improvements  that  can  be  achieved  with 
candidate  controls  and  disolays  in  a variety  of  windshear  environ- 
ments. 
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INTRODUCTION 


This  study  was  conducted  to  determine  the  minimum  update  rate  of  a 
forcing  function  display  required  for  the  operator  to  approximate  the 
tracking  performance  obtained  on  a continuous  display.  Previous  studies 
(see  review  by  Frost,  1972,  p.  287)  using  time  on  target  as  a measure  of 
performance,  obtained  a breakdown  in  performance  around  15  samples  per 
second.  In  this  study,  frequency  analysis  was  used  to  determine  whether 
there  was  an  associated  change  in  the  transfer  function  characteristics  of 
the  operator.  It  was  expected  that  as  the  forcing  function  display  update 
rate  was  reduced,  from  120  to  15  samples  per  second,  the  operator’s  response 
to  the  high  frequency  components  of  the  forcing  function  would  show  a 
decrease  in  gain,  an  Increase  in  phase  lag,  and  a decrease  in  coherence. 


APPARATUS 


The  forcing  function,  in  each  dimension,  consisted  of  the  sum  of  nine 
sine  waves  and  simulated  a Gaussian  noise  passed  through  a second  order 
filter  with  a roll-off  frequency  at  1 Hz.  The  forcing  function  was 
generated  at  rates  of  120,  60,  30,  or  15  samples  per  second  and  presented  on 
the  screen  at  these  update  rates.  An  optical  projection  system  consisting 
of  a low  power  laser  and  a pair  of  galvo-mirrors  rear  projected  the  forcing 
function  onto  a cloth  screen  in  the  form  of  a spot  of  red  light  randomly 
moving  in  two  dimensions  about  a center  spot  marked  on  the  screen.  The 
maximum  excursion  of  the  forcing  function  was  +5®  visual  angle  in  azimuth 
and  elevation,  as  viewed  by  the  subject  (S).  The  +5”  visual  angle  positions 
were  also  marked  on  the  screen  and,  along  with  the  center  spot,  served  as 
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calibration  points  for  both  the  forcing  function  and  S's  eye  movement 
response.  The  subject  tracked  the  forcing  function  from  a position  on  the 
opposite  side  of  the  screen  from  the  optical  projections  system  and  equi- 
distant from  the  screen. 

The  subject's  eye  line-of-sight  was  computed  using  the  AMRL  Honeywell 
Remote  Oculometer.  For  a complete  description  of  the  Oculometer,  see 
Merchant,  et.  al.,  1974.  Calibration  of  the  Oculometer  prior  to  each 
tracking  run  was  accomplished  by  using  a second  optical  projection  system 
positioned  adjacent  to  the  forcing  function  optical  projection  system.  The 
movement  of  the  laser  spot  generated  by  this  second  system  corresponded  to 
the  subject's  eye  line-of-sight.  The  Oculometer-driven  laser  spot  was  turned 
off  during  the  tracking  run. 

Five  channels  of  a seven  channel  1/2-inch  Ampex  300  instrumentation 
tape  recorder  were  used  to  record:  (1)  time  code,  (2)  horizontal  forcing 

function,  (3)  vertical  forcing  function,  (4)  horizontal  eye  movements,  and 
(5)  vertical  eye  movements. 


PROCEDURE 


Four  students,  two  male,  two  female,  from  the  University  of  Dayton 
served  as  subjects  for  this  study.  Each  subject  tracked  the  forcing 
function  twice  at  each  sampling  rate  (eight  tracking  runs  per  subject)  in  a 
partially  balanced  design.  The  data  for  each  subject  was  collected  in  two 
test  sessions  of  four  tracking  runs  each.  After  seating  the  subject,  the 
operation  of  the  Oculometer  was  checked  and  calibrated.  The  subject  was 
instructed  to  sit  in  a natural,  comfortable  position.  The  only  constraint 
placed  upon  the  subject  was  the  Instruction  to  refrain  from  making  large 
head  movement.  The  subject  was  instructed  to  follow  (pursue)  the  moving 
spot  of  light  with  his  eyes  as  the  spot  moved  on  the  screen.  The  subjects 
were  screened  for  uncorrected  20/20  vision.  Between  runs  subjects  were 
given  a short  rest. 


RESULTS 


Frequency  analyses  of  the  data  from  the  four  subjects  were  accomplished 
using  an  IBM  370  Computer  and  the  BMD  X92  program.  For  each  run  the  power 
spectral  density  of  the  forcing  function,  the  power  spectral  density  of  the 
eye  response  output,  the  cross  power  spectral  density,  the  cross  correlation, 
the  coherence,  and  the  transfer  functions  in  gain  and  phase  were  computed. 

The  data  for  the  two  runs  for  a given  sampling  rate  condition  were  averaged, 
for  each  subject,  at  each  of  the  nine  sine  wave  component  frequencies  of  the 
forcing  function. 
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The  average  transfer  function  gain,  averaged  across  subjects^  for  each 
of  the  four  sampling  rates,  are  presented  In  Figure  1 (Horizontal)  and 
Figure  3 (Vertical) . No  differences  attributable  to  sampling  rate  are 
present. 

The  average  transfer  function  phase,  averaged  across  subjects, for  each 
of  the  four  sampling  rates,  are  presented  in  Figure  2 (Horizontal)  and 
Figure  4 (Vertical) . An  increase  in  transport  delay  of  approximately  30  msec 
was  observed  at  the  15  samples  per  second  update  rate  for  both  the  horizontal 
and  vertical  tracking  data. 

The  coherence  data  averaged  around  .98  with  a slight  drop  off  at  the 
high  frequencies  and  showed  no  differences  attributable  to  the  sampling 
rate  of  the  forcing  function. 


DISCUSSION 


The  lowest  update  rate  used  in  this  study  (15  samples  per  second)  was 
not  low  enough  to  have  an  appreciable  effect  upon  the  transfer  function 
characteristics  of  the  operator.  Further  research  is  planned  using  lower 
update  rates.  Expected  changes  at  the  high  frequency  sine  waves  components 
of  the  forcing  function  not  observed  In  this  study  may  be  observed  at  lower 
update  rates.  A time  on  target  analysis  of  the  data  Is  planned  to  determine 
whether  the  results  of  this  study  correspond  with  the  results  previously 
reported. 
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Figure  1.  Horizontal  Gain  as  a Function  of  Update  Rates 


Figure  2.  Horizontal  Phase  as  a Function  of  Update  Rates 
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Figure  3.  Vertical  Gain  as  a Function  of  Update  Rates 


Figure  4.  Vertical  Phase  as  a Function  of  Update  Rates 
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INTRODUCTION 


The  basic  purpose  of  this  experiment  was  to  compare  head  tracking 
performance  at  various  angles  from  the  straight  ahead  position.  In  our 
pre<7lous  laboratory  studies  (e.g.  Shirachl  and  Black,  1975;  Hornseth, 
Stanley,  and  Carson,  1976;  and  Shirachl,  Monk,  and  Black,  1976)  head 
tracking  was  performed  within  a + 15®  or  less  cone  about  the  straight 
ahead  or  boreslght  position.  Honejnjell  has  conducted  studies  in  which  the 
subjects  aimed  their  heads  as  far  off  boreslght  as  40®  (Hughes,  et  al, 
1970).^  Their  subjects  slewed  their  heads  in  the  direction  indicated  by  an 
arrow,',  on  the  head  position  display  they  were  using,  until  a target  came 
into  t^ie  field  of  view  of  the  helmet  mounted  display.  At  this  point  their 
task  bteame  that  of  laying  a reticle  over  the  target  to  achieve  lock  on. 

The  leiigth  of  time  the  subjects  were  actually  tracking  was  only  a few 
seconds.  Flight  test  studies  conducted  at  Tyndall  AFB  and  China  Lake 
(Dietz  at  al,  1971  and  Grossman,  1974)  investigated  head  tracking  perform- 
ance wh+ch  included  large  off-boreslght  angles.  The  target  motion  in  these 
two  studjLes  was  highly  predictable. 

\ 

One  of  the  big  advantages  of  a helmet  sight  in  a high  performance 
aircraft  io  its  off-boresight  capability  in  aiming  a fire  control  system. 
However,  tracking  data  using  a target  that  is  moving  rapidly  and  randomly 
for  an  extended  period  of  time  is  missing.  This  study  is  intended  to 
provide  data  in  this  area  that  will  be  of  value  to  engineers  in  designing 
head  control  systems. 


425 


METHOD 


Apparatus: 

A PDF  11/34  minicomputer  with  floating  point  hardware  was  used  to 
generate  the  forcing  function,  digitize  and  record  4 analog  data  channels 

(azimuth  and  elevation  of  both  the  target  and  head  motion),  and  perform 

some  data  analyses.  A Honeywell  helmet  mounted  sight  (HMS)  was  used  to 
sense  the  subject's  head  angles  as  he  tracked  Che  target.  This  helmet 
system  weighed  1.65  kg.  A Hughes,  side  mounted,  helmet  display  was  used  to 
present  the  moving  target  and  head  position  reticle  to  the  subject's  right 
eye.  This  helmet  mounted  display  weighed  .54  kg.  An  IMLAC  POS-4  computer 
graphics  display  generated  the  target  and  reticle  symbology  using  the 
forcing  function  and  the  head  position  signals  to  position  the  target 
symbol  relative  to  the  reticle.  An  Ampex  FR-1300  Instrumentation  tape 
recorder  was  used  to  record  the  subjects'  responses,  the  forcing  function, 
and  a time  code.  An  IBM  370/155  was  used  for  data  analysis  and  plotting. 

The  forcing  function  was  updated  at  a 90  He  rate.  The  HMS  provided 

head  azimuth  and  elevation  angles  at  a 30  He  rate.  The  IMLAC  was  "free 
running"  at  approximately  a 1000  He  refresh  rate. 


Forcing  Function: 

The  forcing  functions  were  generated  from  a sum  of  sine  waves  with  the 
amplitudes  scaled  to  simulate  white  noise  passed  through  a second  order 
filter  with  a break  frequency  of  0.7  He.  More  information  on  the  forcing 
function  can  be  found  in  Appendix  A.  The  phase  relationships  between  the 
sine  waves  were  randomly  varied  from  subject  to  subject  but  remained 
constant  across  a given  subject's  conditions.  Pilot  study  data  indicated 
that  there  was  negligible  learning  across  6 runs  with  the  same  forcing 
function. 


Procedure: 

Each  subject  performed  the  head  tracking  under  6 head  position 
conditions.  The  following  mean  azimuth  and  elevation  angular  positions 
were  used: 

0*,  0*  (center-center);  0",  +30*  (center-up);  0*,  -30*  (center-down);  -45*, 
0*  (left-center);  -43*,  +30*  (left-up);  and  -45*,  -30*  (left-down).  Because 
of  symmetry  of  the  left-right  neck  muscles  and  pilot  study  data,  only  the 
left  hemisphere  of  head  motion  was  investigated.  Performance  at  angles 
further  off-center  were  not  selected  for  examination  because  pilot  study 
data  suggested  that  the  limits  of  head  and  neck  motion  may  be  exceeded  at 
larger  angles  for  some  subjects.  Other  supporting  data  give  the  average 
limit  of  male  neck  movement  for  up  flexion  at  61*  with  S.O.  of  27*  down 
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flexion  at  60*  with  S.D.  of  12*,  and  left  or  right  rotation  at  79*  with  S.D. 
of  14*  (Van  Cott  and  Klnkade,  1972).  The  maximum  excursion  of  the  target 
from  each  of  the  6 head  positions  was  +10*.  This  small  excursion  was  used  to 
Increase  the  probability  the  target  would  remain  on  the  subjects’  display  at 
all  times  and  not  require  the  subject  to  search  for  It.  Also,  the  small 
target  excursions  constrained  the  subjects  to  track  at  various  mean  angular 
positions  within  the  head  motion  envelope  to  provide  an  adequate  representa- 
tion of  head  tracking  at  the  specified  off-center  positions. 

Each  tracking  run  was  100  seconds  long.  The  first  9 seconds  of  tracking 
were  not  scored  to  allow  the  subject  to  overcome  the  Initial  ’’start  up” 
error  Induced  by  the  target  suddenly  Jumping  to  a random  starting  position 
and  beginning  tc  move.  The  following  91  seconds  of  tracking  data  were 
recorded  and  scored.  At  the  end  of  each  run  a rest  period  of  1 minute  was 
given.  After  each  group  of  3 runs,  the  rest  period  was  extended  to  5 minutes. 
The  first  6 runs  were  practice  runs,  allowing  for  the  subjects  to  adjust  to 
head  tracking  at  each  angular  position.  All  practice  runs  were  presented  to 
each  subject  in  the  same  order.  The  data  runs  were  presented  In  a randomized 
order  to  reduce  any  possible  ordering  effects.  All  subjects'  scores 
asymptoted  to  an  acceptable  level  of  performance  during  the  practice  runs. 


Subjects: 

Fourteen  male  subjects  were  used  with  ages  ranging  from  16-40.  Eye 
dominance  was  tested  for  each  subject  with  about  half  reporting  right  eye 
dominance.  The  subjects' instructions  are  given  in  Appendix  B. 


RESULTS  & DISCUSSION 


A subject's  performance  scores  were  computed  from  his  radial  error  data. 
Radial  error  Is  the  visual  angle  from  a subject's  line  of  sight  to  the 
target  at  each  instant  In  time.  The  Duncan's  New  Multiple  Range  Test  (NMRT) 
was  used  to  test  for  statistical  differences  In  performance  at  the  6 head 
angle  positions.  Table  1 shows  the  3 homogenous  subsets  of  head  positions 
found  using  the  50%  circular  error  probability  (CEP)  metric  (a  50%  CEP 
refers  to  that  radius,  about  the  target,  within  which  the  subject  tracked 
50%  of  the  time).  The  best  performances  (lowest  CEP),  denoted  by  the 
A subset,  was  found  when  the  head  faced  center-center,  left-center,  and 
left-down.  The  next  best  performance,  the  B subset,  was  obtained  when  the 
head  faced  center-center,  left-up,  left-down,  and  center-up.  The  worst 
performance,  subset  C,  was  found  when  the  head  faced  center-down,  center-up, 
and  left-up.  It  should  be  noted  that  the  differences  between  the  best 
position  (-45*,  00*)  and  the  worst  position  (00*,  -30*)  Is  small,  .15*  or 
6%.  While  this  difference  Is  statistically  significant,  it  Is  left  up  to 
the  designers/engineers  to  determine  if  the  difference  Is  of  practical 
significance. 
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Establishment  of  on  target  g..  e rings  were  done  as  an  analysis  pro> 
cedure  after  data  collection.  However^  during  the  experimental  runs,  the 
subjects  were  not  required  to  keep  the  target  within  a gate  ring,  nor  were 
they  shown  any  rings.  In  analyzing  the  data,  a subject  was  considered  on 
target  if  his  radial  error  was  less  than  a specified  tolerance.  Six  on 
target  tolerance  rings  were  used  in  analyzing  the  data  collected  in  this 
experiment.  They  ranged  from  1”  to  6”,  in  1*  increments.  Gate  times  were 
computed  for  each  tolerance  ring.  Gate  time  was  defined  to  be  the  amount 
of  time  a subject  kept  the  target  inside  the  ring.  As  soon  as  the  target 
was  outside  the  ring,  that  gate  time  ended.  If  the  target  was  again  inside 
the  ring,  another  gate  time  was  started.  To  reduce  "noise"  effects  in  this 
gate  time  measure,  an  arbitrary  dead  time  zone  of  .1  seconds  was  used.  This 
meant  that  not  only  must  the  target  be  within  the  ring  to  start  a gate,  it 
must  also  be  within  for  .1  second.  Likewise,  it  must  be  outside  of  the  ring 
for  .1  second  to  end  the  gate.  The  mean  gate  times  for  each  ring,  averaged 
over  all  positions,  are  shown  in  figure  1.  Using  the  Duncan's  test,  the 
gate  time  metric  did  not  prove  to  be  a sensitive  measure  for  dlstlnqulshlng 
among  the  angular  positions  (Tables  2-7).  For  all  of  the  tolerance  rings, 
except  the  4*  ring,  performance  at  the  6 head  positions  did  not  differ 
significantly  from  each  other.  The  4*  ring  indicated  that  the  longest  gate 
times  were  obtained  at  all  positions  except  left-up  and  center-down.  The 
next  subset  included  all  positions  except  left-center. 

The  time  on  target  (TOT)  scores,  for  each  tolerance  ring,  were  computed 
by  multiplying  the  mean  gate  times  by  the  number  of  times  the  target  stayed 
within  the  ring.  The  mean  TOTs  for  each  ring,  averaged  across  all  positions, 
is  shown  in  figure  2.  The  Duncan's  test  was  applied  to  each  of  the  6 rings 
to  determine  homogenous  subsets.  As  shown  in  Table  8 for  the  1*  tolerance 
band,  there  are  no  significant  differences  among  any  of  the  6 angular 
positions.  As  the  task  becomes  easier,  by  increasing  the  tolerance  ring 
to  2*,  the  Duncan's  test  indicates  that  3 homogenous  subsets  exist.  As 
with  the  CEP  metric,  the  TOT  with  a 2*  ring  has  the  best  scores  at  the 
center-center,  left-center,  and  left-down  (Table  9).  Next  best  scores  are 
center-center,  left-up  and  down,  and  center-up.  The  worst  scores  are 
center-center,  left-up,  and  center-up  and  down.  Increasing  the  ring  size  to 
3*,  there  are  still  3 homogenous  subsets  (Table  10).  The  best  and  second 
best  scores  remain  the  same,  while  the  worst  score  is  found  to  be  the 
center-down  position.  With  the  rings  at  4*  and  5*,  only  2 homogenous  sub- 
sets are  found  (Tables  11  and  12).  The  best  scores  are  the  same  positions 
as  those  in  the  2*  and  3*  rings.  The  second  best  positions  are  also  the 
same  as  in  the  2*  and  3*  ring  plus  the  center-down  position  is  included  in 
this  subset.  The  6*  tolerance  ring,  the  easiest  task,  also  has  3 homo- 
genous subsets  (Table  13).  The  best  positions  were  found  to  include  all 
positions  except  center-down,  while  the  next  best  included  all  positions 
except  left-center.  For  this  condition,  both  significantly  different 
subsets  have  almost  merged  into  a single  subset. 
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A two  way  analysis  of  variance  was  used  to  test  for  significances  in 
RMS  error  scores.  No  significant  difference  was  found  between  azimuth 
versus  elevation  RMS  errors  (Table  14).  Significance  at  the  p ■ .001  level 
was  found  between  the  6 angular  positions.  The  head  position  by  azimuth- 
elevation  dimension  interaction  was  also  found  to  bw  significant  at 
p • .001  level. 

A Duncan's  test  was  performed  to  compare  RMS  error  scores  between  the 
0 angular  positions  for  both  azimuth  and  elevation.  Two  homogenous  subsets 
were  found  with  the  azimuth  scores  (Table  15).  The  best  performance  was 
the  center-center  and  all  left  positions.  With  the  elevation  RMS  error 
scores,  3 homogenous  subsets  were  found,  but  with  a different  grouping  than 
the  other  metrics  have  found  (Tabic  16).  The  best  performance  was  at 
left-center,  left-down,  and  center-down.  This  was  the  only  time  th*?t  the 
center-down  position  was  in  the  best  performance  grouping  when  multiple 
groups  were  found.  The  nest  subset  contained  the  left-down,  center,  center- 
up,  and  center-down  conditions.  The  worst  position  was  the  left-up  position. 


CONCLUSIONS 


The  3 primary  metrics,  CEP,  TOT,  and  gate  times,  all  emphasize  a 
different  aspect  of  tracking  performance,  but  they  are  not  independent  of 
each  other.  Thus,  it  is  not  surprising  that  the  Duncan's  test  should 
generally  designate  the  same  position  subsets.  In  almost  all  the  tests,  the 
best  position  was  the  left-center,  followed  by  the  center-center  and  left- 
down  positions.  Again,  it  should  be  emphasized  that  all  of  the  differences 
found  were  small  but  statistically  significant.  However,  they  may  or  may 
not  be  practically  significant.  The  helmet  mounted  sight  and  helmet  mounted 
display  used  for  this  experiment  were  earl/  prototypes.  The  later  models  of 
each  unit  are  lighter  and  have  a much  improved  center  of  gravity.  Both  of 
these  factors  may  eliminate  even  the  statistical  significant  differences 
among  the  positions  within  the  envelope  +45*  azimuth  and  +30®  elevation. 


APPENDIX  A 

The  sum  of  cine  wave  input  was  chosen  such  that  it  simulated  white 
noise  passed  through  the  second  order  system  ( • Eleven  sine 

frequencies,  for  azimuth  were  selected  on  the  basis  of  being  equal  spaced 
between  0.10  H*  and  2.00  He  on  a log.Q  scale.  For  elevation,  the  11  sine 
frequencies  were  also  spaced  equally^on  a log.Q  scale  with  the  frequencies 
being  midway  between  the  azimuth  frequencies.^  iheir  frequencies  ranged 
from  0.12  He  to  2.32  He.  An  additional  requirement  placed  upon  frequency 
selection  was  that  the  resultant  input  must  complete  a full  cycle  at  the 
run's  end.  Thus,  all  frequencies  must  be  a liarmonlc  of  the  fundamental 
frequency.  For  this  experiment,  the  fundamental  frequency,  f ■ 

= • .01099  He. 

91,02  seconds 
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APPENDIX  B 


Subject  Instructions:  ”Your  task  in  this  experiment  will  be  to  head  track 

a rapidly  moving  target.  In  the  head  mounted  display,  located  in  front  of 
your  right  eye,  you  will  notice  a reticle  at  the  center  of  the  display. 

This  reticle  will  always  remain  at  the  center  of  the  display  as  you  move 
your  head.  Please  move  your  head  around  a little  so  that  you  can  see  which 
of  the  two  objects  is  actually  the  reticle.  The  object  that  moves  around  on 
the  display,  as  you  move  your  head,  is  the  target.  During  the  test  runs, 
the  target  will  move  around  in  a rapid,  random  pattern.  Your  task  will  be 
to  move  your  head  so  as  to  keep  the  center  of  the  reticle  as  near  the  center 
of  the  target  as  you  can.  The  test  runs  will  last  90  seconds.  After  each 
test  run,  you  will  be  given  a 1 minute  rest  period  before  the  next  run. 
Please  remain  seated  during  these  short  rest  periods.  Each  test  run  will 
require  you  to  track  the  target  with  your  head  aimed  in  a different 
direction.  You  will  first  be  given  some  practice  in  tracking  at  each  of  the 
6 head  positions  used  in  the  experiment.  Then  you  will  be  given  the  experi- 
mental runs.  After  each  group  of  3 runs  you  will  be  allowed  to  get  up  out 
of  the  chair  to  stretch  and  walk  around.  If  at  any  time  you  have  any 
questions  about  what  you  are  to  do,  be  sure  to  ask  for  additional  instruc- 
tions or  clarifications.  Do  you  have  any  questions  at  this  time?” 
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FIGURES  AND  TABLES 


FIGURE  1 

MEAN  GATE  TIMES  FOR  EACH  GATE 
TOLERANCE  RING,  AVERAGED  ACROSS 
ALL  HEAD  POSITIONS 


FIGURE  2 

MEAN  TIME  ON  TARGET  FOR  EACH 
TOLERANCE  RING,  AVERAGED  ACROSS 
ALL  HEAD  POSITIONS 
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TABLE  1 

DUNCAN'S  NMRT  FOR  THE  MEAN  CEP 
SCORES  AT  THE  6 HEAD  POSITIONS 


CEP  (DEGREES) 

EL  (DEC) 

ftZ 

(DEG) 

“15 

0 

♦30 

2.60 

2.61 

BC* 

BC 

0 

2.51 

2.55 

R 

RB 

“30 

2.57 

2.66 

RB 

c 

TABLE  2 

DUNCAN'S  NMRT  RESL’LTS  FOR  THE 
1®  GATE  TIME  SCORES  AT  THE 
6 HEAD  ANGLE  POSITIONS 


r GATE  TIMES  (SEC) 

EL  (DEC) 

flZ  (DEC) 

-qS 

m 

♦30 

0.15 

R 

0.16 

R 

0.16 

R 

0.15 

R 

-30 

0.16 

R 

0.15 

R 

TABLE  3 

DUNCAN'S  NMRT  RESULTS  FOR  THE 
2®  GATE  TIME  SCORES  AT  THE 
6 HEAD  ANGLE  POSITIONS 


2®  GATE  TIMES  (SEC) 

EL  (DEG) 

# 

nz  (DEG) 

-11 'i 

0 

♦30 

0.28 

R 

0.28 

R 

0 

0.29 

R 

0.23 

R 

1 

1 

CO 

o 

0.29 

R 

0.28 

R 

TABLE  4 

DUNCAN'S  NMRT  RESULTS  FOR  THE 
3®  GATE  TIME  SCORES  AT  THE 
6 HEAD  ANGLE  POSITIONS 


3°  GATE  TIMES  (SEC) 

EL  (DEG) 

nz  (DEC) 

•«15 

m 

♦ 30 

O.GO 

R 

0.59 

R 

0 

0.6»1 

R 

0.62 

R 

-30 

0.62 

R 

0.58 

R 

* For  all  Duncan's  NMRT  tables  In  this  report,  letters  represent  homogenous 
subsets.  The  mean  performance  scores  contained  In  a subset  do  not  differ 
significantly  from  other  means  contained  In  that  subset.  The  means  not 
contained  In  the  same  subset  are  significantly  different  at  the  p ■ .05 
level.  A given  mean  can  belong  to  more  than  one  subset. 
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TABLE  5 

DUNCAN'S  NMRT  RESULTS  FOR  THE 
4“  GATE  TIME  SCORES  AT  THE 
6 HEAD  ANGLE  POSITIONS 


4®  GATE  TIMES  (SEC) 

EL  (DFG) 

nz  fOEG)  i 

-45 

0 

♦30 

i.m 

6 

1.52 

R6 

0 

1.85 

R 

1.57 

RB 

-30 

1.59 

m 

1.33 

B 

TABLE  6 

DUNCAN'S  NMRT  RESULTS  FOR  THE 
5*  GATE  TIME  SCORES  AT  THE 
6 HEAD  ANGLE  POSITIONS 


5*  GATE  TIMES  (SEC) 

EL  (DEC) 

flZ  (OEG) 

-45 

0 

♦30 

4.54 

R 

4.62 

R 

0' 

5.12 

R 

4.59 

R 

-30 

4.42 

R 

4.13 

R 

TABLE  7 


DUNCAN'S  NMRT  RESULTS  FOR  THE 
6*  GATE  TIME  SCORES  AT  THE 
6 HEAD  ANGLE  POSITIONS 


6®  GATE  TIMES  (SEC) 

EL  (DEC) 

nz  (DEG) 

-45 

0 

♦30 

17.2 

R 

19.2 

R 

0 

20.0 

R 

20.3 

fl 

-30 

19.5 

R 

13.6 

R 

TABLE  8 

DUNCAN'S  NMRT  RESULTS  FOR  THE 
1®  TIME  ON  TARGET  SCORES  AT 
THE  6 I^iU)  ANGLE  POSITIONS 


1®  TOT  (%) 

EL  (DEC) 

HZ  (OEG) 

-45 

0 

♦30 

4.52 

R 

4.56 

R 

0 

5.15 

R 

4.73 

R 

-30 

5.22 

R 

4.66 

R 
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TABLE  9 

DUNCAN’S  NMRT  RESULTS  FOR  THE 
2“  TIME  ON  TARGET  SCORES  AT 
THE  6 HEAD  ANGLE  POSITIONS 


2® 

TOT  {%) 

El.  (DEO) 

nz 

(DEO) 

-43 

0 

»30 

BC 

28. 'I 

BC 

q” 

30.  V 
1] 

29.3 

mc^ 

-30 

09.6 

m 

27. ‘1 

c 

TABLE  10 

DUNCAN’S  NMRT  RESULTS  FOR  THE 
3®  TIME  ON  TARGET  SCORES  AT 
THE  6 HEAD  ANGLE  POSITIONS 


3°  TOT  (%) 

El.  (DEC) 

flz  (on;) 

-4D 

0 

♦30 

97. ‘1 

B 

!3 

0 

60.3 

fl 

90.7 

no 

-30 

98.3 

m 

TABLE  11 

DUNCAN’S  NMRT  RESULTS  FOR  THE 
4®  TIME  ON  TARGET  SCORES  AT 
THE  6 HEAD  ANGLE  POSITIONS 


4®  TOT  [%) 

EL  (DEC) 

nz  U1EG) 

-Il5 

0 

♦30 

79.2 

B 

78. 8 

B 

0 

82.0 

fl 

1)0.5 

tlB 

78.3 

B 

-30 

1 

79.9 

m 

TABLE  12 


DUNCAN'S  NMRT  PvESULTS  FOR  THE 
5®  TIME  ON  TARGET  SCORES  AT 
THE  6 HEAD  ANGLE  POSITIONS 


1 5®  TOT  i%) 

EL  (IJEG) 

nz  (l)'rG)  1 

-'19 

0 

. 

♦30 

91.6 

B 

91.7 

B 

0 

93.6 

n 

92.6 

._JL„ 

-30 

92.2 

HB 

9!.0 

B 
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TABLE  13 

DUNCAN'S  NHRT  RESULTS  FOR  THE 
6**  TIME  ON  TARGET  SCORES  AT 
THE  6 HEAD  ANGLE  POSITIONS 


6®  TOT  {%) 

El.  (DEC) 

nz  (OFC) 

-'15 

0 

♦30 

9/.;* 

m 

97.  q 

m 

0 

fi 

97.7 

fiO 

•30 

97./ 

fin 

96.9 

B 

TABLE  14 

ANALYSIS  OF  VARIANCE  TABLE  OF  RMS  ERROR 


Source  of  Variation 

or 

Sum  of  Souares 

Wear  Square 

n 

P 

A (AZ-EL  Dimension) 

1 

.17 

4.53 

>.05 

6 (Angular  Positions) 

5 

.46 

.09 

5.01 

<.001 

C (Subject) 

13 

7.16 

.55 

65.82 

A X C 

5 

.27 

.05 

6.42 

<.001 

A X C 

13 

.50 

.04 

4.56 

R X C 

65 

1.19 

.02 

2.19 

A X B X C i 

1 

65 

.54 

.01 

Total 

167 

10.30 
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TABLE  15 


DUNCAN'S  NMRT  RESULTS  FOR  THE  AZDflJTH  RMS 
ERROR  SCORES  AT  THE  6 HEAD  ANGLE  POSITIONS 


AZ  RMS  E (DEG) 

EL  (DEC) 

nZ  (DEC)  1 

-•15 

0 

♦30 

2,23 

m 

2,25 

B 

0 

2.15 

n 

2.15 

R 

-30 

2.23 

RB 

2.31 

B 

TABLE  16 

DUNCAN'S  NMRT  RESULTS  FOR  THE  ELEVATION  RMS 
ERROR  SCORES  AT  THE  6 HEAD  ANGLE  POSITIONS 


EL  RMS  E (DEG) 

EL  (DEC) 

nz  (DEC) 

•••15 

0 

♦30 

2.29 

c 

2.20 

13 

0 

2.05 

R 

2.16 

13 

-30 

2.11 

RB 

2.13 

RB 
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IIN79-15619 

LIGWrWEIGHT  HELMET-MOUNTED  EYE  MOVEMENT  MEASUREMENT  SYSTEM 

John  A.  Barnes 

US  Axriy  Human  Engineering  Laboratory 
Aberdeen  Proving  Ground,  Maryland 


We  first  realized  the  need  for  a simple,  easy  to  use,  lightweight 
device  to  determine  the  aircrewman*s  fixation  points  and  paths  of  eye  move- 
ment between  fixation  points  when  we  performed  our  initial  eye  movement 
measurement  work.  We  used  a Mackworth  EMC- 2 device,  figure  1,  to  determine 
a helicopter  pilot's  visual  work  load  during  actual  flight. 


Figure  1.  EMC- 2 Eye-Movement  Camera 

The  development  of  the  present  system  has  been  a "spare- time"  project 
since  1971.  The  components  have  been  procured  whenever  funds  were  available 
or  a particular  project  required  their  use.  The  interface  coo^)onents  were 
constructed  by  our  shop  personnel  during  slack  periods  in  their  work 
schedules.  There  are  no  custom  designed  components  in  the  present  system; 
every  item  is,  or  is  made  up  from  commercially  available  consonants. 

The  helmet  we  used  is  the  type  that  preceded  the  present  US  Army 
aviators'  helmet.  It  has  been  modified  slightly:  a small  amount  of  material 
has  been  removed  from  immediately  above  the  brow  to  accommodate  the  camera 
case,  the  visor  has  been  removed  and  the  suspension  system  has  been  replaced 
with  a removable,  subject- fitted,  molded  plastic  foam  inner  helmet  similar 
to  the  one  used  in  the  USAF  HCU-2  flight  helmet.  The  fitted  helmet 
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stabilizes  the  optical  head  and  helps  to  keep  the  system  in  calibration 
during  use.  The  helmet-mounted  eye  movement  measuring  system,  figure  2, 
weighs  1,530  grams;  the  weight  of  the  present  aviators'  helmet  in  standard 
form  with  the  visor  is  1,545  grams. 


Front  view  of  the  system. 


System  in  the  stowed  position. 


Figure  2.  Lightweight  Helmet-Mounted  Eye  Movement  Measurement  System 

The  optical  head  is  a standard  NAC  Eye-Mark.  This  optical  head  was 
mounted  on  a magnesium  yoke  which  in  turn  was  attached  to  a slide  cam 
mounted  on  the  flight  helmet.  The  slide  cam  allows  one  to  adjust  the  eye- 
to-optics  system  distance  quite  easily  and  to  secure  it  so  that  the  system 
will  remain  in  calibration.  The  design  of  the  yoke  and  slide  cam  is  such 
that  the  subject  can,  in  an  emergency,  move  the  optical  head  forward  and 
upward  to  the  stowed  and  locked  position  atop  the  helmet.  This  feature  was 
necessary  for  flight  safety. 


The  television  camera  that  is  used  in  the  system  is  a solid  state 
General  Electric  TN-2000  with  i charged  induced  device  (CID)  imager  used  as 
the  vidicon.  This  particular  device  has  45,000  cells  which  form  the  video 
picture.  The  charged  coupled  device  (CCD)  solid  state  imagers  are  also 
available  but  the  CID  imagers  have  an  advantage  in  that  they  do  not  "bloom" 
as  badly  when  they  are  struck  by  a bright  light.  Fairchild  now  offers  a 
CCD  imager  which  contains  185,440  cells  and  produces  a more  detailed  video 
picture;  this  was  not  available  when  our  system  was  assembled.  The  CID 
imager  is  mounted  on  the  NAC  optical  head  in  place  of  the  standard  fiber 
optics.  The  camera  electronic  package  which  measures  7)$  x 2 x 4 inches  and 
weighs  less  than  two  pounds  is  placed  in  the  pocket  of  a vest  worn  by  the 
subject.  The  imager  and  electronic  package  are  connected  by  a very  thin 
ribbon  cable  which  is  42  inches  long. 


The  output  of  the  system  cun  be  sent  to  the  video  monitor  and  recorder 
by  direct  wire  or  by  the  use  of  video  transmitter.  It  can  be  transmitted 
over  a range  of  3,000  feet.  The  video  transmitter  measures  ^ x 3 x 3^ 
inches  and  weighs  Ih  pounds;  it  can  be  placed  in  another  pocket  of  the 
subject's  vest. 
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All  components  of  this  system  operate  on  12  volts  or  less.  The  power 
can  be  supplied  from  a belt>type  battery  pack  or  can  be  taken  fxom  the 
vehicle  electrical  system;  the  total  power  reqtiirement  for  the  subject 
mounted  equipment  is  less  than  three  anperes. 

A coiQ)ling  lens  is  required  to  match  the  optical  output  from  the  NAC 
optical  head  to  the  CID  imager.  The  design  of  the  lens  used  detezmines  the 
distance  between  the  optical  head  and  the  CID  imager. 

For  applications  where  the  helmet  is  not  necessary,  the  system's  video 
conqjonents  can  be  used  with  the  standard  EYE-MARK  face  mask  mount.  For  our 
own  laboratory  use  we  have  replaced  the  snap  fasteners  of  the  face  mask 
mount  with  VELCRO  for  easier  and  faster  adjustments. 

This  system  is  not  without  its  difficulties;  the  video  presentation  is 
not  as  precise  as  a film  rendition  of  the  same  scene  but  the  instant  feed- 
back is  worth  the  degradation  of  the  presentation.  For  most  purposes  little 
or  no  information  is  lost  by  using  the  video  recordings.  When  the  system  is 
used  to  investigate  visual  behavior  where  the  fixation  points  will  be  at 
distances  greater  than  100  meters,  there  is  an  inherent  problem  in  the  EYE- 
MARK.  Tlte  light  marker  that  indicates  the  subject's  fixation  point  is  a 
fixed  size,  .5  mm,  and  as  the  scene  lens  presents  an  increased  scene  area 
this  fixed  mark  increases  in  size  relative  to  the  rest  of  the  presentation. 
We  have  had  limited  success  in  decreasing  the  size  of  the  light  marker  by 
reducing  the  size  of  its  aperture.  This  also  decreases  the  marker's 
brightness  and  it  will  no  longer  be  visible  on  the  scene  presentation.  The 
minimum  aperture  size  that  we  have  been  able  to  use  is  .11  inches  Cnormal  is 
,16),  this  reduces  the  light  marker  size  by  about  one- third.  One  further 
problem  that  might  bother  some  is  that  the  video  presentation  is  a mirror 
image  of  the  real  world,  the  fiber  optics  systems  contains  a mirror  which 
is  not  used  with  this  video  system.  We  rectify  this  by  placing  a front 
surface  mirror  at  some  comfortable  angle  in  front  of  the  monitor  and  view 
the  video  picture  from  a position  above  and  behind  the  monitor. 

The  Fiscal  Year  1977  cost  to  the  Covemroent  for  the  system  components 

was: 


NAC  EYE-MARK  Optical  Head  $ 3,420.00 
GE  TN-2000  CID  Video  Camera  2,925.00 
Sony  AV-3400  Video  Recorder  888.75 
Sony  CVM-115  Monitor/Receiver  252.00 
VM-2200  Video  Transmitter  IS  mw  1,584.00 
Coupling  Lens  400.00 


The  "off-of-the-shelf"  cost  of  the  complete  system  was  $9,469.75.  This  cost 
does  not  reflect  the  cost  of  interfacing  these  conq;>onents  into  a system; 
this  will  vary  with  the  user's  support  resources  but  should  not  exceed 
$500.00. 

We  have  field  tested  the  system  to  check  its  performance  with  the 
performance  specifications  given  by  NAC  for  the  optical  head.  The  subject's 
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head  was  fixed  in  position  so  that  all  recorded  movement  was  pure  eye  move- 
ment and  the  recorded  errors  were  from  eye  movement  only.  The  targets  were 
set  at  a distance  of  100  meters  from  the  subject  and  extended  in  an  arc  of 
11^  either  side  of  the  center  target.  The  NAC  specifications  indicated  a 
maximum  error  of  2°  of  arc  at  10**  either  side  of  the  center  position;  this 
is  3.5  meters  error  at  100  meters  range.  Ke  measured  3.6  meters  at  10^  on 
a smoothed  curve  of  the  42  data  points  recorded.  We  have  found  in  our  work 
that  a 3^  eye  movement  will  be  tolerated  before  the  head  is  moved,  thus  with 
this  system  for  3°  of  eye  movement  we  have  an  error  of  1 meter  at  100  meters 
range,  10  cm  at  10  meters  range  and  1 cm  at  1 meter  range. 

The  listing  of  trade  name  products  in  this  article  is  not  to  be  taken 
as  an  indorsement  of  these  products.  They  were  the  products  that  were 
available  at  the  time  of  procurement  which  met  our  requirement  that  all 
elements  of  the  system  operated  on  12  volts  DC.  They  were  the  least  costly 
items  that  met  that  requirement  and  that  were  cosq[)atiblo  with,  or  could 
easily  be  made  compatible  with,  the  other  elements  of  the  system. 
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SUMMARY 


The  indifference  thresholds  for  the  perception  of  tilt  in  the  roll  axis 
were  experimentally  deteirmined  in  a moving  base  simulator  under  three  track- 
ing task  difficulties.  The  threshold  level  determined  in  this  experiment  is 
approximately  5 to  7 degrees  (*lg). 


INTRODUCTION 


In  ground  based  simulat  rs,  unlike  aircraft,  false  tilt  cues  may  occur 
when  they  are  rolled.  The  amount  of  tilt  which  can  be  detected  by  the  pilot 
in  the  simulator,  defined  as  the  Indifference  threshold,  appears  to  be  a func- 
tion of  the  task  being  performed.  To  eliminate  the  false  tilt  cues  that  occur 
when  the  indifference  threshold  is  exceeded,  washout  schemes  are  used  to  limit 
the  motions  of  the  simulator.  This  is  often  accomplished  by  limiting  the 
amount  of  roll  of  the  simulator  while  still  allowing  the  acceleration  and 
other  helpful  cues  to  be  felt  by  the  pilot.  In  the  past  the  washouts  used 
were  based  on  what  felt  good  to  the  pilot  in  the  simulator.  Very  little  data 
is  available  relative  to  what  this  threshold  is,  see  reference  1,  and  what 
factors,  if  any,  alter  the  level  of  indifference.  Data  in  the  past  has  dealt 
with  determining  the  absolute  threshold.  One  set  of  data,  see  reference  2, 
does  show  that  the  ‘‘absolute**  threshold  Increases  when  workload  is  Increased. 
This  prompted  an  investigation  to  determine  the  effect  of  workload  on  the  in- 
difference threshold  level  for  use  in  washouts  and  in  motion  related  param- 
eters of  pilot  modeling. 

An  experiment  was  performed  to  determine  the  indifference  threshold  and 
the  interactive  effect  of  the  tracking  task  on  the  threshold  value.  This 
expr'riment  and  associated  results  are  presented  in  this  paper. 

METHOD 


The  basic  idea  behind  the  experiment  was  to  have  a subject  track  a closed 
loop  disturbance  nulling  task  and  then  superimpose  a random  appearing  ramp 
(tilt  input)  to  the  motion  loop  of  the  simulator.  Figure  1 is  a block  diagram 


443 


of  the  motion  and  visual  systems  used  in  the  experiment  showing  the  location 
of  the  disturbance  input  and  the  tilt  input  to  the  motion  plant  in  the  system. 
The  only  input  was  the  disturbance  input  so  the  display  was  the  negative  of 
the  simulated  plant  position.  When  the  subject  could  detect  the  tilt  input, 
he  was  to  indicate  the  direction  of  the  tilt  via  a hand-held  indicator  con- 
taining a left  and  a right  thumb  actuated  pushbutton.  The  subject  was  in- 
structed to  hold  the  pushbutton  down  until  he  no  longer  felt  that  he  was 
tilted.  The  time  histories  of  the  chair  position,  the  tilt  input  and  the 
hand-held  indicator  signals  were  recorded  and  later  analyzed. 

The  experiment  was  run  on  the  Roll  Axis  Tracking  Simulator  (RATS)  at  the 
Aerospace  Medical  Research  Laboratory  at  Wright-Pat terson  Air  Force  Base. 

The  RATS  is  capable  of  simulating  the  roll  dynamics  of  a high  performance 
aircraft,  in  this  case,  an  F-16.  The  plant  dynamics  are  described  by  equation 
1 with  limits  of  180®/sec  and  400®/sec2.  The  cab  contains  a CRT  mounted  at 
the  axis  of  rotation  which  is  through  the  head  of  the  subject.  The  subject 
viewed  the  display  shown  in  figure  2 which  was  26  inches  away.  The  subject 
used  a force  stick  mounted  on  the  right  side  of  the  cab  to  control  the  track- 
ing task.  To  prevent  the  subject  from  experiencing  any  external  cues,  a 
shroud  inclosed  the  cab,  white  noise  was  injected  iii  the  helmet  and  the  room 
lights  were  extinguished.  In  addition,  a harness  was  used  to  keep  the  subject 
in  his  seat  while  the  cab  was  in  motion. 

Three  sum  of  sine  inputs,  simulating  white  noise  passed  through  a low- 
pass  filter  with  a double  pole  at  2 radians,  were  used  with  RMS  values  of 
.933,  1.40,  and  .467  pounds  which  resulted  in  14,  21,  and  7 degrees/second 
root  mean  squared  (RMS)  variance  in  the  visual  error.  A group  of  ten  subjects 
were  exposed  to  the  inputs  in  the  order  mentioned  above.  They  ran  4 runs  a 
day  for  3 days,  with  each  run  lasting  165  seconds.  The  subjects  had  been 
trained  from  a previous  experiment,  therefore,  minimum  training  was  required. 
Data  from  the  last  two  days  was  used  for  subsequent  analysis.  An  example  of 
a data  run  can  be  seen  in  figure  3.  The  top  trace  is  a time  history  of  the 
negative  visual  error  (simulated  plant  position)  seen  by  the  subject.  The 
negative  of  the  visual  error  is  shown  so  that  it  can  easily  be  compared  to  the 
actual  motion  plant  seen  in  trace  3.  This  was  the  tracking  task  he  was  trying 
to  null  out  by  keeping  the  wings  on  the  display  level  with  the  dashed  refer- 
ence line.  The  second  trace  shows  the  offset  signal  that  was  added  to  the  cab 
position.  The  resulting  cab  position  during  the  tracking  task  is  shown  in 
trace  3*  A run  consisted  of  from  zero  to  four  of  the  offset  signals  to  maxi- 
mize randomness  between  runs.  The  offset  signal  itself  occurred  at  a rate  of 
l®/sec  with  limits  of  ±20  degrees.  The  l®/sec  value  was  chosen  because  it  is 
below  the  roll  velocity  threshold  of  2®/sec,  see  reference  1.  The  last  graph 
is  the  output  of  the  hand-held  indicator  the  subject  used  to  Indicate  when  the 
tilt  was  felt* 

In  addition  to  the  tracking  data  taken,  a set  of  baseline  data  for  each 
subject  was  recorded*  This  data  provides  a baseline  Indifference  threshold, 
comparable  to  the  absolute  threshold  data  taken  in  previous  experiments.  The 
subject  was  asked  to  sit  quietly  in  the  cab  while  the  cab  was  tilted,  using 
the  same  tilt  input  described  earlier.  The  subject  was  to  indicate  the  direc- 
tion of  tilt  as  he  did  before.  The  tracking  task  was  not  present  and  the 
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display  remained  fixed  on  the  screen. 

RESULTS 

The  results  are  sho^^m  in  figures  4 through  7 and  summarized  in  figure  8. 
For  each  group*  the  offset  angle*  at  the  point  when  the  indicator  button  was 
pressed  was  recorded  and  placed  in  groups  of  half  degree  increments.  The 
number  of  points  recorded  in  each  half  degree  group  was  then  plotted  in  his- 
togram form  with  the  mean  and  standard  deviation  shown  for  each  group.  The 
mean  values  for  the  indifference  threshold  increases  with  the  difficulty  of 
the  task.  Fewer  data  points  were  needed  for  the  baseline  data  due  to  the 
smaller  amount  of  variance  across  subjects. 

The  summary  shows  a baseline  level  of  3.48®  (.06g)  which  jumps  to  6.46® 
(.113g)  with  the  least  difficult  task  and  7.56®  (.132g)  with  the  most 
difficult.  These  results  are  discussed  in  the  following  section. 

DISCUSSION 

From  the  baseline  data*  the  indifference  threshold  level  is  3.48®  (.06g) 
This  value  can  be  compared  to  data  taken  from  other  experiments  where  the 
absolute  threshold  was  determined  but,  the  results  from  this  experiment  are 
3 to  30  times  higher,  see  reference  1.  This  is  due  to  the  conditions  under 
which  the  experiment  was  run.  These  conditions  added  extra  loading  to  the 
subjects  tilt  detection*  similar  to  the  kind  of  loading  he  would  receive  when 
running  in  a simulator.  Under  these  "real  world"  conditions,  the  simulator 
environment*  a useful  measurement  of  the  indifference  threshold  is  made  and 
can  be  directly  applied  to  washout  designs  and  used  in  pilot  modeling. 

Figures  5 through  7 show  the  results  when  tracking  tasks  of  varying 
difficulties  are  added  to  the  baseline  conditions.  The  results  of  all  four 
conditions*  summarized  in  figure  8*  contained  the  type  of  trend  as  expected, 
see  reference  2.  The  summary  shows  a sharp  Jump  from  the  baseline  to  the 
least  difficult  of  the  three  tracking  tasks  and  then  Increasing  threshold 
levels  with  the  difficulty  of  the  task.  The  various  difficulties  were  obtain 
ed  by  increasing  the  tasks  RMS  value  which  had  the  effect  of  changing  the 
signal  to  noise  ratio  of  the  system.  This  change  accounts  for  part  of  the 
increase  in  the  threshold  levels  as  well  as  the  increase  in  the  variance  of 
the  data.  The  relatively  large  jump  from  the  baseline  is  due  to  the  initial 
loading  of  the  subject  by  the  tracking  task. 

CONCLUSIONS 

In  this  paper,  an  experiment  to  investigate  the  effects  of  the  tracking 
task  workload  on  the  indifference  threshold  is  described.  Based  on  the  re- 
sults and  the  discussion,  the  following  conclusions  can  be  drawn. 

1)  The  indifference  threshold  increases  with  task  loading. 

2)  The  tilt  indifference  threshold  while  performing  a tracking  task  is 
approximately  .Ig. 
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Fig*  3.  Sample  Data 
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Fig.  4.  Results  of  the  Baseline  Data 
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Fig.  5.  Results  of  the  7“  RMS  Tracking  Task 
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Fig.  6.  Results  of  the  14®  RMS  Tracking  Task 


Fig.  7.  Results  of  the  21“  RMS  Tracking  Task 
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Fig.  8.  Data  Summary 
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ABSTRACT 


An  experimental  and  analytical  study  was  undertaken  jointly  by  the 
Aerospace  Medical  Research  Laboratory  and  Bolt  Beranek  and  Newman  Inc.  to 
explore  the  effects  of  the  tilt  cue  on  pllot/vehicle  performance  in  a simu- 
lated heading  tracking  task.  The  task  was  performed  with  subjects  using 
visual-only  cues  and  combined  visual  and  roll-axis  motion  cues.  Half  ot 
the  experimental  trials  were  conducted  with  the  simulator  rotating  about 
the  horizontal  axis;  to  suppress  the  tilt  cue*  the  remaining  trials  were 
conducted  with  the  simulator  cab  tilted  90®  so  that  roll-axis  motions  were 
about  earth  vertical. 

The  presence  of  the  tilt  cue  allowed  a substantial  and  statistically 
significant  reduction  in  performance  scores.  When  the  tilt  cue  was  sup- 
pressed* the  availability  of  motion  cues  did  not  result  in  significant 
performance  improvement.  These  effects  were  accounted  for  by  the  optimal- 
control  pilot/vehlcle  model*  wherein  the  presence  or  absence  of  various 
motion  cues  was  represented  by  appropriate  definition  of  the  perceptual 
quantities  assumed  to  be  used  by  the  human  operator. 


* This  research  was  supported  in  part  by  AFOSR  under  Contract  No.  FA4620- 
7A-C-0060. 
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INTRODUCTION 


One  of  the  problems  associated  with  ground-based  motion  simulation  is 
the  introduction  of  unwanted  or  "false”  cues  that  are  not  present  in  three 
dimension ol  flight.  The  particular  set  of  such  false  cues  present  in  a given 
Simula:. Con  depends  both  on  the  nature  of  the  flight  task  and  the  degrees  of 
freedom  of  the  moving-base  simulator. 

This  paper  reviews  the  results  of  a recent  experimental  and  analytical 
Study  to  explore  the  pilot's  ability  to  use  the  "tilt  cue"  (l.e.,  the  devia- 
tion of  the  effective  "gravity  vector"  from  the  usual  head-to-seat  orienta- 
tion). Such  a cue  is  "false",  for  example,  if  it  is  present  in  the  simula- 
tion of  a constant  rate  coordinated  turn.  This  study  was  performed  as  part 
of  a multi-year  collaboi ative  effort  between  Bolt  Beranek  and  Newman  and  the 
Aerospace  Medical  Research  Center  to  develop  a model  of  the  pilot’s  use  of 
roll-axis  motion  cues.  Results  obtained  in  the  preceding  phases  of  this 
program  have  been  reported  in  References  [1-5] ; documentation  of  the  study 
reviewed  below  is  in  preparation.* 


DESCRIPTION  OF  EXPERIMENTS 


Preliminary  model  analysis  was  conducted  using  the  optimal-control 
pilot/vehicle  model  to  search  for  an  experimental  task  for  which  performance 
would  be  sensitive  to  the  presence  or  absence  of  the  tilt  cue.  This  analysis 
revealed  that  simple  roll-axis  tasks  of  the  type  explored  previously  would 
not  be  sufficiently  sensitive.  When  the  addition  of  another  Integration  to 
the  system  dynamics  was  found  to  provide  the  desired  predicted  sensitivity, 
the  heading  tracking  task  diagrammed  in  Figure  1 was  adopted  for  this  study. 
In  all  experimental  trails  the  subject  was  provided  with  a visual  display  of 
heading  error  as  sketched  in  Figure  2. 

Motion  about  the  roll  axis  was  provided  by  the  Dynamic  Environmental 
Simulator  (DES) . When  the  roll  axis  of  the  simulator  was  in  the  normal 
horizontal  orientation,  a roll  displacement  provided  the  subject  with  a tilt 
cue.  The  tilt  cue  was  suppressed  by  rotating  the  DES  90  degrees  so  that 
the  pilot  was  In  the  supine  position.  In  this  position  gravity  acted  normal- 
ly to  the  plane  of  rotation  and  could  not  provide  the  pilot  with  information 
related  to  the  tracking  task.  Motion  was  provided  only  in  the  roll  axis; 
yaw  motion  was  absent. 


Vehicle  dynamics  were  of  a higher  order  than  those  explored  in  the  pre- 
ceding study.  The  DES  Itself  provided  approximate  dynamics  of  a single  pole 


* Levlson,  W.  H.  and  A.  M.  Junker,  "Modeling  the  Pilot's  Use  of  a Roll-Axis 
Tilt  Cue",  BBN  Report  No.  3802,  Bolt  Beranek  and  Newman  Inc.,  Cambridge, 
Mass,  (in  preparation). 
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Figure  1 . Block  Diagram  of  the  Tracking  Task 


ERROR 


Figure  2.  Sketch  of  the  Central  Visual  Display 
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at  2 rad/sec  and  a conq>lex  pole  pair  having  a natural  frequency  at  about 
10  rad/sec.  "Target"  motion  was  provided  by  a sum  of  sinusoids  designed  to 
approximate  a second-order  noise  process. 

Subjects  were  Instructed  to  minimize  a weighted  sum  of  mean  squared 
heading  error  and  mean  squared  roll  acceleration  and  were  trained  to  near 
asymptotic  performance  on  each  of  the  four  experimental  conditions. 


SUMMARY  OF  RESULTS 


The  comparison  between  predicted  and  measured  rms  performance  scores 
presented  in  Figure  3 shows  that  the  model  predicted  the  major  trend  of  the 
experiment:  namely,  that  motion  cues  would  benefit  performance  to  a greater 
extent  when  the  tilt  cue  was  present  (l.e.,  horizontal  roll  axis).  This 
comparison  is  perhaps  better  illustrated  in  Figure  4 in  which  static-motion 
differences  in  rms  scores  are  shown  for  all  performance  measures.  For  the 
most  part,  predicted  differences  were  within  one  standard  deviation  of  the 
difference  scores  obtained  experimentally.  For  roll  axis  horizontal,  the 
model  predicted  a smaller  decrease  in  the  error  score  and  a greater  decrease 
in  the  acceleration  score  than  revealed  by  the  data.  Predicted  static/ 
motion  performance  differences  were  generally  less  than  observed  experimen- 
tally for  roll  about  the  vertical;  however,  observed  differences  were  largely 
not  statistically  significant. 

Model  predictions  shown  in  Figures  3 and  4 were  obtained  with  pilot- 
related  parameters  selected  as  Indicated  in  Table  1.  On  the  basis  of  results 
obtained  in  a study  of  simulator  washout  effects  [3],  a "residual  noise"  of 
15  degrees  was  associated  with  perception  of  plant  roll  angle  from  t.ie  tilt 
cue.  Because  of  the  relatively  large  roll  rates  and  accelerations  required 
to  perform  the  tracking  task,  perceptual  thresholds  and  residual  noise  terms 
for  other  motion-related  cues  were  considered  negligible. 

The  informational  analysis  adopted  in  previous  studies  was  used  to 
account  for  the  presence  or  absence  of  motion  cues.  For  roll  about  the  hori- 
zontal axis,  moving-base  simulation  was  assumed  to  provide  the  pilot  with 
information  related  directly  to  vehicle  roll  angle,  roll  rate,  roll  accelera- 
tion, and  roll  acceleration  rate.  We  further  assumed  that  attention  would 
be  shared  between  visual  cues  as  a group  and  motion  cues  as  a group  and  that 
the  pilot  would  allocate  attention  between  these  two  sets  of  cues  in  a way 
that  would  minimize  the  objective  performance  cost.  A similar  treatment  was 
adopted  for  roll  about  the  vertical  axis,  only  in  this  case  the  pilot  was 
assumed  to  obtain  no  cue  related  directly  to  plant  position,  and  zero  atten- 
tion was  ascribed  to  this  variable.  The  model  for  static  tracking  was 


* The  reader  is  directed  to  References  1-5  for  a review  of  the  optimal- 
control  model  and  its  treatment  of  motion  cues. 
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Figure  4.  Differences  Between  Motion  and 
Static  Performance  Scores 
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identical  for  the  pilot  in  the  upright  and  supine  positions*  Relative  atten- 
tions of  0.5  and  0.2  to  motion  variables  were  predicted,  respectively,  for 
the  cases  of  tilt  cue  present  and  tilt  cue  absent. 


Table  1 

Nominal  Values  for  Pilot-Related  Model  Parameters 


Motor  time  constant 
Time  delay 

Driving  motor  noise/ 
signal  ratio 

Pseudo  motor  noise/ 
signal  ratio 

Observation  noise/signal 
ratio  for  ”full  attention** 

Perceptual  threshold, 
indicator  displacement 

Perceptual  threshold, 
indicator  velocity 


C. 1 seconds 
0.2  seconds 
. (negligible) 

-35  dB;  relative 
to  control  variance 

-20  dB  relative  to 
signal  variance 

0.05  degrees 
visual  arc 

0.05  degrees/second 
visual  arc 


Figure  5 shows  that  the  model  correctly  predicted  many  of  the  detailed 
changes  in  pilot  response  behavior  induced  by  the  moving-base  simulation. 

For  roll  about  the  horizontal,  the  model  showed  a substantial  increase  in  low- 
frequency  phase  shift,  a small  decrease  in  amplitude  ratio,  and  a decrease  in 
input-correlated  control  power  at  low  frequencies.  For  vertical-axis  roll, 
the  model  correctly  predicted  a small  Increase  in  low-frequency  phase  and, 
in  general,  no  appreciable  changes  in  other  frequency- response  measures. 

The  model  also  predicted  the  following  effects  that  were  not  observed 
experimentally:  decreased  input-correlated  and  remnant-related  control  power 

at  high  frequencies  for  horizontal-axis  roll,  and  Increased  low-frequency 
remnant  power  for  roll  about  the  vertical.  Errors  in  predicting  the  effects 
of  motion  simulation  on  low-frequency  remnant  power  arose  primarily  from 
the  tendency  of  the  model  to  predict  considerably  less  remnant  in  the  static 
case  than  was  observed  experimentally. 

The  subjects  used  in  these  experiments  were  instructed  only  to  mininiize 
‘*otal  **cost**;  they  were  not  instructed  as  to  the  desired  control  strategy. 

One  might,  therefore,  expect  the  subjects  to  have  adonted  strategies  differ- 
ent from  that  predicted  by  the  model,  provided  such  non-optimal  behavior  had 
neglible  effect  on  total  cost. 
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(o)  ROLL  AXIS  HORIZONTAL  (b)  ROLL  AXIS  VERTICAL 


Figure  5.  Comparison  Between  Model  and  Experimental 

Frequency-Response,  Nominal  Parameter  Values 
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Selected  pilot-related  parameters  were  varied  to  determine  the  extent 
to  which  matching  errors  could  be  attributed  to  performance  insensitivity. 
Specifically,  time  delay  and  cost  weightings  were  modified  in  such  a way  that 
total  cost  was  virtually  unchanged  (an  increase  of  less  than  3%.)  Figure  6a 
shows  that  the  ability  of  the  model  to  match  pilot  response  behavior  at  high 
frequencies  was  substantially  improved  by  this  procedure.  To  this  extent, 
differences  between  predicted  and  observed  measurements  can  be  attributed  to 
"pilot  preference"  of  the  type  that  does  not  noticeably  affect  performance. 

Errors  in  modeling  low-frequency  aspects  of  response  behavior  could 
not  be  attributable  to  pilot  preference,  however.  Low-frequency  remnant 
power  for  static  tracking  was  matched  only  by  an  increase  in  observation 
noise  - specifically,  noise  associated  with  perception  of  heading  era  r. 

The  match  to  low-frequency  phase  shift  for  the  motion  case  was  improved  by 
assuming  less  than  optimal  attention  to  motion  cues.  The  resulting  improve- 
ment in  model-matching  capability  is  demonstrated  in  Figure  6b. 


DISCUSSION  OF  RESULTS 


The  results  of  this  study  indicate  that  a simple  Informational  analysis 
is  sufficient  to  account  for  much  of  the  Influence  of  the  tilt  cue  in  tasks 
involving  roll-axis  motion.  Specifically,  one  assumes  that  the  pilot  direct- 
ly perceives  the  bank  angle  of  the  (.uoving)  vehicle  if  the  tilt  cue  is  pres- 
ent; otherwise,  this  element  is  omitted  from  the  pilot's  "display  vector". 

The  remaining  motion- related  cues  of  roll  rate,  roll  acceleration,  and  roll 
acceleration  rate  are  assumed  available  in  both  situations. 

One  should  not  Interpret  the  results  of  this  study  as  indicating  that 
the  tilt  cue  will  generally  be  of  significance  in  a task  involving  roll-axis 
motions.  On  the  contrary,  the  degree  to  which  the  tilt  cue  provides  usable 
Information  to  the  pilot  depends  on  the  details  of  the  tracking  task.  (In 
Fact,  considerable  pre-experimental  model  analysis  was  required  to  design  an 
experimental  task  in  which  performance  would  be  significantly  influenced  by 
the  presence  or  absence  of  the  tilt  cue.) 

The  "residual  noise"  of  15  degrees  associated  with  perception  of  the 
tilt  cue  is  not  to  be  Interpreted  as  a detection  threshold,  but  rather  as  a 
measure  of  uncertainty  associated  with  this  perceptual  variable  in  the  con- 
text of  a continuous  tra'.king  task.  Since  a "residual  noise"  is  roughly 
equivalent  to  a "thre-jliol f of  one-third  the  value  in  terms  of  the  optimal- 
control  pilot  model  [6] , the  resl'’.ual  noise  of  15  degrees  is  consistent  with 
an  Indifference  threshold  of  a’aout  5 degrees  recently  obtained  in  an  experi- 
ment requiring  simultaneous  detection  of  tilt  and  continuous  roll-axis 
control  [7] . 

To  some  extent,  insensitivity  o.*’  performance  to  pilot  response  stra- 
tegy appears  to  have  allowed  the  subjects  to  "trade"  acceleration  score  for 
error  score  when  performing  the  tracking  task  with  roll  motion  about  the 
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(o)  IMPROVED  MATCH  (bl  BEST  MATCH 


Figure  6.  Comparison  Between  MOdel  and  Experimental  Frequency 
Response,  Parameter  Values  Adjusted  for  Better  Hatch 
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horizontal  axis^  However,  performance  insensitivity  does  not  explain  the 
relatively  large  noise/signal  ratio  (equivalently,  low  attention)  associated 
with  perception  of  heading  error  in  the  fixed-base  tracking  task.  Increas- 
ing this  parameter  from  the  nominal  -20  dB  to  -5  dB  to  provide  the  best 
match  to  the  experimental  results  increased  the  predicted  total  cost  by 
about  20%  - an  increase  too  large  to  ascribe  to  pilot  indifference. 

A more  consistent  explanation  of  these  results  is  that  the  high  noise 
level  may  have  reflected  increased  uncertainties  about  vehicle  response 
characteristics  caused  by  the  relatively  high  order  of  the  plant  dynamics 
(two  pure  integrations  plus  additional  lags  to  represent  the  dynamics  of  the 
rotating  simulator).  When  motion  cues  were  present,  the  controllers  may 
have  obtained  sufficient  additional  information  about  the  state  of  the  con- 
trolled plant  to  minimize  this  uncertainty;  hence,  the  ability  to  match 
moving-base  response  behavior  with  nominal  noise  levels.  Improved  modeling 
of  pilot  response  behavior  In  situations  Involving  high-order  dynamics  is 
a possible  area  for  future  research. 


461 


REFERENCES 


Levison,  W.  H.,  S,  Baron  and  A,  M.  Junker,  "Modeling  The  Effects  of 
Environmental  Factors  on  Human  Control  and  Information  Processing," 
AMRL-TR-76-74 , Wright-Patterson  Air  Force  Base,  Ohio,  August  1976* 

Levison,  W,  H.  and  A,  M.  Junker,  "A  Model  for  the  Pilot's  Use  of 
Motion  Cues  in  Roll-Axis  Tracking  Tasks,"  AMRL-TR-77-40,  Wright- 
Patterson  Air  Force  Base,  Ohio,  June  1977. 

Levison,  W.  H. , "A  Model  for  the  Pilot's  Use  of  Roll-Axis  Motion 
Cues  in  Steady-State  Tracking  Tasks",  Bolt  Beranek  and  Newman  Inc, 
Report  No.  3808,  May  1978. 

Le\dison,  V.  H.,  "Use  of  Motion  Cues  in  Steady-State  Tracking", 

NASA  TM  X-73,  170,  Twelfth  Annual  Conference  on  Manual  Control,  Urbana, 
Illinois,  May  1976. 

Levison,  W.  H.  and  A.  M.  Junker,  "Use  of  Motion  Cues  in  Two  Roll-Axis 
Tracking  Tasks",  Procedings  of  the  Thirteenth  Annual  Conference  on 
Manual  Control.  M.I.T.,  Cambridge,  Mass.,  June  15-17,  1977. 

Kleinmn,  D.  L.  and  S.  Baron,  "Analytic  Evaluation  of  Display  Require- 
ments for  Approach  to  Landing",  NASA  CR-1952,  November  1971. 

M.  Roark  and  A.  Junker,  "The  Effects  of  Closed  Loop  Tracking  on  a 
Subjective  Tilt  Threshold  in  the  Roll  Axis",  Procedings  of  Fourteenth 
Annual  NASA-Universitv  Conference  on  Manual  Control,  University  of 
Southern  California,  April  25-27,  1978. 


N79-15622 

ROLL  TRACXINO  X77ECTS  OF  Q-VECTOR  TILT  AND  VARIOUS 
TYPES  OF  MOTION  WASHOUT 


Henry  B*  Jex  and  Rayinond  E.  Magdalene 
Systems  Technology,  Inc. 

Hawthorne,  California 

and 

Andrew  M.  Junher 

6^70th  Aerospace  Medical  Research  Lab,  EM  Branch 
Wright-Patterson  AFB,  Ohio 


SUMMARY 


The  aim  of  this  research  was  to  discover  the  basic  effects  on  pilot  roll 
tracking  behavior,  performance,  and  impressions  for  several  types  of  motion- 
reducing  logic  ("washouts")  used  in  moving-base  simulators.  It  was  a joint 
program  between  the  675O  Aerospace  Medical  Research  Laboratory  (AMRL-EM 
Branch)  and  Systems  Technology,  Inc. 

The  e3q)eriments  were  performed  on  the  AMRL  Dynamic  Environment  Simulator 
(DES),  in  the  roll  degree  of  freedom  only.  The  g- vector  was  oriented  both 
normally  (pilot  erect,  tilt  cue  present)  and  90  deg  nose-up  (pilot  supine,  no 
tilt  cue) . Washout  filters  included;  second  order,  first  order,  attenuated 
first  order,  attenuated,  and  static  (fixed  base) . 

In  a dogfight  scenario,  t;he  task  was  to  follow  the  target's  roll  angle 
while  suppressing  gust  disturbances.  The  two  independent  inputs  (interleaved 
sum-of-sinea)  enabled  identification  of  both  the  visual  and  motion  response 
parameters  of  the  pilot  by  the  STI  Model  Fitting  Program  (MFF*77).  A 12- 
parameter  multiloop  model  structure  fitted  includes  separate  visual  and  roll 
motion  sensing  channels,  with  a common  neuromuscular  actuator  block. 

Excellent  describing  function  and  performance  data  as  well  as  subjective 
impressions  were  obtained  on  four  non-pilot  subjects,  each  well  trained  in 
the  "real-world"  case  (full  motion;  90  deg  nose-up) . All  subjects  adopted 
the  sare  behavioral  strategies  in  following  the  target  while  suppressing  the 
gusts,  and  the  MFP-fitted  math  model  response  was  generally  within  one  "data 
symbol  width." 

The  results  include  the  following: 

• Comparisons  of  full  roll  motion  (both  with  and  without  the 

spurious  gravity  tilt  cue)  with  the  static  case.  These  motion 
cues  help  suppress  disturbances  with  little  net  effect  on  the 
visual  performance.  Tilt  cues  were  clearly  used  by  the  pilots 
but  gave  only  small  improvement  in  tracking  errors. 
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• The  optimum  washout  (in  terms  of  performance  close  to  "real 
world,"  similar  behavioral  parameters,  significant  motion 
attenuation  (60  percent),  and  acceptable  motion  "fidelity") 
was  the  combined  attenuation  and  first-order  washout. 

• Various  trends  in  parameters  across  the  motion  conditions  were 
apparent,  and  are  discussed  with  respect  to  a comprehensive 
model  for  predicting  pilot  adaptation  to  various  roll  motion 
cues. 

The  detailed  data  base  (spectra,  remnant,  describing  functions,  model 
fits)  are  compiled  in  a separate  document  available  to  interested  researchers 
through  AMRL-EM. 


imODUCTION 


Ob;)ectlves  and  Background 

A joint  ej^erimental/analytical  effort  by  the  Aerospace  Medical  Research 
Laboratory  (AMRL/EM)  and  Systems  Technology,  Inc.  (STI)  was  conducted  to 
define  a pilot's  use  of  motion  cues  in  moving-base  simulators  free  to  rotate 
only  in  the  roll  degree  of  freedom.  Tliis  situation  provides  the  pilot  an 
intrinsically  spurious  roll  attitude  or  "tilt"  cue.  This  effect  can  be  re- 
duced by  "washing  out"  the  cab  motion  so  the  cab  always  tends  to  return  to  an 
upright  orientation,  althoiigli  this  distorts  the  true  angular  motions.  Tixe 
optimization  of  the  washout  cynamics  to  achieve  the  best  compromise  between 
realistic  roll  rate  cues  and  suppression  of  the  spurious  tilt  cue  is  an  impor- 
tant facet  of  the  immediate  future  work  to  be  done  in  the  AMRL/EM  laboratory. 

The  basic  objective  was  to  determine  what  form  and  degree  of  v/ashout  dy- 
namics achieves  the  highest  simulation  realism,  while  engendering  true-to-life 
behavior  of  the  pilot,  and  producing  the  correct  performance  effects  due  to 
environmental  stressors.  Longer  range  objectives  include  the  possible  cor- 
relation of  these  experiments  with  other  ground-based  simulations  and  later 
with  in-flight  experiments. 

To  accomplish  the  above  objectives  this  i>^.vestigation  had  to  consider  two 
basic  problems  in  moving-base  simulation:  the  use  of  motion  cues  by  the  pilot 
in  the  actual  ("real  world")  case  and  the  effects  of  spurious  motion  cues  in 
modifying  that  usage  in  the  simulator.  A brief  examination  of  the  piloting 
task  involved  in  the  first  problem  is  useful  before  proceeding  to  the  second. 

Consider  a situai.ion  of  primary  interest  to  the  Aii-  Force  — air-to-air 
combat  — and  focus  upon  the  pilot's  response  to  the  dynamic  (non-steady)  com- 
ponents of  motion.  Assume  that,  initially,  the  pilot  has  his  wings  lined  up 
with  those  of  a target  aircraft  that  he  perceives  against  a murky  or  night-tinie 
background  (no  horizon  visible).  In  this  "impoverished  display"  sj-tuation 
he  can  visually  perceive  only  the  difference  (error)  between  the  target's 
wings  and  his  own.  .Further,  the  pilot  has  twc'  tasks  to  perform,  often 
s inPiltaneously : 
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a.  Regulate  (suppress)  distvirbances,  e.g.,  due  to  gusts  or  swirls 
from  the  target's  wingtip  vortices.  In  this  task  the  pilot's 
role  is  to  reduce  motions,  and  if  he  suppresses  the  gusts 
with  small  error,  the  physical  motions  become  small. 

b.  Track  (follow)  the  target  roll  motions  (e.g.,  by  keeping  one's 
wings  parallel  with  the  target).  In  this  task  the  pilot's 
role  is  to  produce  motions,  and  if  he  tracks  with  small  error, 
the  physical  motions  become  larger  (approaching  the  target 
motions) . 

In  the  general  case,  where  both  inputs  are  present,  the  pilot  is  faced 
with  a continual  conflict  between  reducing  disturbance  motion  and  producing 
correct  following  motions.  The  figuxe-of~merit  (at  least  in  air  combat  and 
landing  tasks)  is  primarily  low  roll  error  (and,  perhaps,  limited  roll  accel- 
eration or  its  rough  equivalent  — aileron  control  deflection) , Because 
multiple  sensory  feedbacks  are  involved,  with  more  than  one  input,  the  problem 
is  a raultiloop  one,  and  this  greatly  complicates  the  control  system  analysis 
as  well  as  the  attempt  to  infer  the  pilot's  behavioral  "structure"  and  para- 
meters, as  will  be  demonstrated,  herein. 

Most  of  the  earlier  research  in  measuring  the  use  of  visual  and  motion 
cues,  such  as  that  of  Stapleford,  et  al  (Ref.  i)  and  Shirley  (Ref.  2),  tended 
to  have  either  the  target  input  or  disturbance,  as  dominant,  such  that  the 
possible  cue  conflicts  were  minimized.  Stapleford,  et  el  were  able  to  infer 
the  separate  visual  and  motion  pathway  dynamics  by  using  mathematically  inde- 
pendent target  and  dislorbance  inputs  comprising  sums-of- sinusoids  inter- 
leaved in  frequency,  then  interpolating  between  frequencies  to  solve  the 
simultaneous  vector  equations  required  to  untangle  the  loops  (this  process 
will  be  shown  later  herein) . However,  these  pioneering  results  were  not 
fitted  in  any  form  suitable  for  efficient  use.  Thus,  the  secondary  objec- 
tives of  this  program  were  to  improve  the  reduction  and  analysis  ol  multi- 
sensory  manual  control  data,  and  to  structure  and  parameterize  the  results . 

Here,  where  the  target  following  and  disturbance  motions  were  comparable,  in 
bandwidth  and  amplitude,  new  techniques  were  required. 

Such  a situation  seem  natura.1  for  an  optimal  control  model  of  the  human 
operator,  and  Le  rison,  working  with  AMRjj  experimenters  has  put  forth  a first- 
cut  at  Just  such  a model  iii  Refs.  3 and  4.  The  forcing  functions  were  either 
target  inputs  or  disturbances,  and  effects  similar  to  Stapleford 's  and  Shirley's 
were  obtained.  Whether  or  not  their  (implicitly)  assumed  feedback  structure 
is  valid  is  hard  to  say  without  more  data  on  the  all  important  dual-input  case 
treated  here.  ' 

In  atiothe.v  approach  Zacharias  (Ref,  5)  has  tackled  the  problem  of  sensory 
conflict  of  visual  and  vestibular  sensors  ir  conjunction  with  regulation  of 
purely  visual,  purely  motion  or  conflicting  cue  situations,  and  has  speculated 
on  a cue-corflict  resolving  model  for  the  human  operator,  in  the  yaw-only 
degree  of  freedom.  Testing  the  validity  of  such  cue- conflict- resolution 
approaches  as  these  requires  a very  solid  data  base  to  exercise  one's  model 
against,  and  this  is  still  largely  lacking.  In  light  of  the  above  needs,  a 
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third  objective  was  to  establish  a very  solid  and  comprehensive  data  base, 
using  inputs,  controlled  elements,  and  washouts  that  were  analytically  tract- 
able and  fairly  linear,  so  that  future  validation  of  cue-utilization  models 
would  be  facilitated. 


Scope 

To  meet  these  objectives,  the  AMRL  Dynamic  Environmental  Siimalator  (DES) 
was  employed,  which  permits  pilot  rolling  motions  with  his  rolling  axis  hori- 
zontal (normal  spurious  tilt  cues  present)  as  well  as  vertical  (tilt  cues 
absent) . Details  are  given  later.  The  scenario  selected  was  that  of  air- 
combat  with  a set  of  fairly  sluggish  aircraft  roll  dynamics,  so  that  motion 
cues  Would  be  useful.  As  will  be  described,  the  target  and  disturbances  were 
carefully  designed  to  provide  strong  motion-usage  conflicts  as  well  as  easy 
analytical  modeling.  Several  motion  cases,  ranging  from  full  motion,  various 
washouts  to  fixed  base  were  included.  Based  on  prior  work,  a plausible  struc- 
ture for  the  pilot's  use  of  visual  and  motion  inputs  was  proposed,  and  a newly 
developed  technique  was  used  to  fit  these  model  parameters  quite  precisely  to 
the  frequency-domain  data. 

We  show  how  some  of  the  past  results  are  explained  on  the  basis  of  dif- 
ferences in  the  apparent  "opened- loop"  transfer  functions  for  target  vs. 
disturbance  inputs,  despite  identical  pilot  behavior  with  respect  to  either 
by  itself. 

To  obtain  reliable  measuremei.es,  worth  fitting  by  the  relatively  high- 
order  models  selected,  extremely  consistent  pilot  behavior  is  necessary.  This 
was  obtained  by  a combination  of  the  sluggish  controlled  element  (which  had 
a fairly  well-defined  optimum  strategy)  and  very  well-trained  subjects. 

The  results  show  clear  answers  to  the  questions  raised  earlier,  when 
analyzed  with  respect  to  various  performance  and  behavioral  (dynamic)  para- 
meters, and  some  interesting  trends  are  evident  in  the  pilot  parameters  vs. 
motion  measures,  even  for  fairly  small  motions.  Nevertheless,  this  report 
does  not  attempt  to  interpret  these  covariations  in  terms  of  an  overall  model 
of  operator  adaptation  to  pure  and  distorted  motion  feedbacks. 


EXPERIMENTAL  DESIGN 


Approach 

As  noted  in  the  introduction,  there  were  two  facets  of  roll  motion-cue 
usage  to  be  Investigated:  "real-world"  motion  vs.  no-motion  and  distortions  of 
real-world  motion  by  various  washout  filters.  In  the  actual  fli.ght  case, 
where  gradual  bank  angles  result  in  translation  of  the  aircraft,  there  is  no 
way  to  tell  vertical,  by  seat-of-the-pants  or  other  vestibular  sensors.  A set 
of  realistic  rolling  cues  were  provided  by  tipping  the  roll-axes  of  the  simu- 
lator 90  deg  nose  upward  so  that  the  spurious  tilt  cues  were  absent.  This 
full-motion  at  90  deg  inclined  roll  axis  (F-90)  case  was  given  the  most 
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practice  and  became  the  "reeil-world''  reference  for  all  other  motion  cases.  By 
comparing  it  with  the  static  case,  tne  basic  effects  of  motion  were  revealed. 
To  check  effects  of  the  conflicts  between  target  following  vs.  disturbance 
regulation,  both  forcing  functions  were  given  alone  and  together  (dual  input) 
for  the  F90  case.  If  the  dual  case  gave  similar  data  as  either  input  alone, 
then  the  dueil  input  could  be  used  throughout,  with  consequent  savings  in  runs 
and  data  analysis. 

The  washouts  in  roll-only  simulators  are  used  for  two  main  purposes,  a) 
to  reduce  the  tilt  cues  (largely  a low  frequency  effect)  and  b)  to  reduce  any 
or  all  motions  (accelerations,  rates,  displacements)  to  fit  into  a limited 
capability  simulator,  always  with  a horizontal  orientation  of  the  roll-axis. 
Consequently  the  effects  of  simulated  roll  only  motions  were  covered  by  the 
full  motion  at  0 deg  roll  axis  inclination  and  various  washouts  — all  selec- 
ted to  give  substantial  reduction  in  roll  displacement. 

To  keep  the  number  of  runs  within  bounds,  it  was  decided  to  keep  constant 
the  plant  and  the  spectrums  of  forcing  functions;  and  to  try  only  one  varia- 
tion of  each  washout  filter  scheme. 


Control  Task 

Block  Diagram  — a scenario  with  high  face  validity  relevant  to  Air  Force 
problems  is  air-to-air  gunnery.  In  a modern  high  thrust/weight  fighter,  com- 
bat maneuvers  take  place  at  all  flight  path  angles,  hence  the  horizon  is 
i’elatlvely  unimportant.  The  main  criterion  for  accurate  tail  chase  is  to 
match  the  roll  angle  of  the  target  aircraft.  The  pilot  is  attempting  to 
follow  an  evasive  target  while  at  the  same  time  he  may  be  buffeted  by  gusts, 
a component  of  which  could  be  wing  tip  vortices  of  the  target.  To  simplify 
the  simulation  and  subsequent  modeling  and  interpretation,  a compensatory  dis- 
play (error  only)  was  used  and  the  subjects  were  instructed  to  minimize  the 
bank  angle  error. 

Fig.  1-a  illustrates  the  basic  elements  involved;  the  Human  Operator, 
Controlled  Element,  and  Washout  dynamics.  The  multilocp  nature  is  evident  in 
that  the  Motion  Path  senses  physical  (inertial)  bank  angle  while  the  Visual 
Path  senses  the  error  between  target  and  task  bank  angle.  (The  four-character 
"names"  on  the  signals  in  Fig.  1 represent  the  Fourier  coefficients  and  are 
used  to  label  some  power  spectra  and  describing  functions  later  In  this  re- 
port) . 


Controlled  Element 

The  controlled  element  (Eq,  1 on  Fig  1-b)  represents  an  approximation  to 
the  roll  dynamics  of  a fighter.  The  Roll  Subsidence  mode,  having  a time  con- 
stant of  1/1.6  » 0.63  sec,  is  typical  of  a loaded  fighter  (i.e.,  with  external 
stores).  This  value  was  selected  a.-  it  would  require  a significant  amount  of 
lead  generation  by  the  pilot,  because  the  Crossover-Law  for  human  operator 
equalization  (e.g..  Ref.  5)  predicts  that  in  such  cases  the  ideal  pilot  lead 
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a.  Block  Diagram  Showing  Definitions  of  Elements  and  Signals 
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Figure  1.  Ron  Tracking  Task  Block  Diagram  and  llransfer  Function 
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would  be  about  Tl  = Tr  = 0.5-0. 7 sec.  The  "Structui’al  Mode"  and  "DE£  lags" 
represent  the  unavoidable  and  measured  response  characteristics  of  th.’ 
motion  simulator,  while  the  "Servo"  Lag  represents  actuation  lags  of  a (poor) 
aircraft  control  system.  It  was  raised  to  0.2  sec  to  prevent  excessive  accel- 
eration or  rate  commands  to  the  DES  which  would  cause  its  drives  to  operate  in 
a partly  saturated  Whence  nonlinear)  manner. 

Analysis  of  this  controlled  element  showed  that  it  requires  a fairly 
tightly  constrained  pilot  equalization,  with  some  lead  to  offset  the  roll- 
subsidence  lag,  but  not  too  much  or  else  the  structural  mode  and  lag  elements 
woiild  destabilize  the  system.  Thus,  there  was  a clearly  optimum  control 
strategy  for  the  subjects  to  learn,  which  was  important  because  they  were 
not  experienced  pilots. 


Forcing  P\inctions 

Quasi-random  target  and  disturbance  inputs  were  constructed  from  eight 
sinusoids  each  (Table  1 ) . The  frequencies  were  selected  so  as  to  have  an 
integer  number  of  cycles  in  the  run  length  as  shown.  To  assure  statistically 
independent  inputs,  target  and  disturbance  frequencies  were  interleaved,  yet 
each  was  approximately  evenly  spaced  on  a log-frequency  plot.  After  these 
choices  were  made  the  amplitudes  were  "shaped"  to  simulate  a random  noise 
process  that  would  result  from  white  noise  being  filtered  by  the  shaping 
filter  forms  given  in  Table  1.  Finally,  these  "shaped  amplitudes"  were 
scaled  so  as  to  give  the  listed  rms  and  peak  amplitude  values. 

The  target's  shaping  filter  was  selected  to  simulate  a low  pass  spectrum 
typical  of  an  evasive  target.  The  disturbance' s shaping  filter  was  selected 
so  that  under  static  conditions  (and,  as  further  shaped  by  the  controlled- 
element)  the  spectral  content  and  rms  ilues  would  be  nearly  equal  to  that 
of  the  target,  ar  seen  on  the  error  display.  Thus  the  pilot  could  not  use 
input  frequency  properties  to  separate  target  motions  from  disturbance  motions. 


Multiloop  Pilot  Model  and  Identification  Procedure 

Analysis.  — The  measurement  problems  involved  in  the  multiloop  system  of 
Fig.  1-a  can  be  illustrated  by  examining  the  task  error  components  resulting 
from  target  and  disturbance  inputs,  shown  in  Fig.  2. 

First  consider  the  static  case,  where  the  Motion  Path  is  inoperative; 
M(ja')  = 0.  Then  the  task  error  vector  ('frequency  response  function)  becomes 
that  given  by  Eq.  2 in  Fig.  2 (for  convenience,  we  have  dropped  the  arguments 
s = ju'  in  each  c'f  the  inputs  and  transfer  functions;  EfjaO  = E,  etc.''. 

Equation  2 has  been  written  in  the  form  of  a conventional  single  loop 
system,  wherein  the  [ ] term  is  the  closed- loop  error- to- input  describing 
function,  so  the  product  V*Yg  is  recognized  as  the  open- loop  describing 


TABLE  1 . FORCING  FUNCTIONS  FOR  DUAL  INPUT  RUNS 


TARGET 

DISTURBANCE 

(rms  = 7. 1 deg)* 

(rms  = .74  lb  = 5.4  N)* 

0) 

(rad/sec) 


2.42  1.0 

4.10  - 5.8 

6.98  -14.4 

11,85  -24.4 


SHAPING  FILTER  FORM 


(D 

(rad/sec) 

0 = 1 . Ibi 

0.55 

-20.6 

0.65 

—16.5 

1.15 

-13.6 

1.88 

-11.4 

3.18 

" 9.7 

5.41 

- 9.2 

9.24 

-10.0 

15.72 

-11.7 

(s  +0.5)(s  + 1.7j(s  +5.0) 


(s  +0.5)(s  +5. 


* For  single  input  runs  the  values  were  increased  by  ^2:} 
t Run  length  = l65.84  sec 

function,  Gq^  for  purely  visual  feedbacks.  Recall  that  increasing  the  magni- 
tude of  Gol  reduces  tracking  errors,  etc. 

Similarly,  in  hypothetical  situations  where  the  operator  would  close  his 
eyes  and  operate  solely  on  motion  cues  (V  = O) , the  task  errors  would  be  given 
by  Eq.  5 in  Fig.  2.  The  input  is  unaffected,  while  the  disturbances  are  sup- 
pressed. 

When  both  visual  and  motion  paths  are  active  the  multiloop  relationships 
become  more  complex,  but  can  still  be  written  so  as  to  reveal  the  effective 
opened- loop  dynamics  (similar  to  Eqs.  2 and  3),  as  shown  in  Eq.  4.  Now, 
however,  the  "opened- loop"  describing  function  for  target  errors  (Gj,  of 
Eq.  4a)  contains  the  closed-motion  loop  1 /( 1 + MNY^),  while  Gp  for  the  dis- 
turbance errors  contain  the  sum  of  motion  and  visual  effects  (V  + MW)Y<,. 
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Disturbance 
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Note:  All  blocks  and  signals  are  vector  functions  of  frequency: 

E = E(jfu)  etc. 
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Figure  2.  Closed-loop  Error  Relationships  to  Target  and  Disturbance 
Inputs  for  Various  Single  and  Multiloop  Structures 
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In  the  single  loop  cases  of  Eqs.  2 and  5 a high-gain  (V  or  M)  reduces 
errors,  but  in  the  multiloop  case  there  is  a conflict: 

• A high-gain  motion  feedback  (large  M)  reduces  the  disturbance 
errors  via  Eqs.  ha  and  4c,  but  increases  the  target  errors 
via  4a  and  4b. 

• A high-gain  visual  loop  (large  V)  reduces  both  error  components. 

• The  optimum  strategy  (to  minimize  E)  is  a complicated  function 
of  the  spectra  of  I and  D*Y^,  as  well  as  of  and  VJ. 

These  are  the  analytical  expressions  for  the  qualitative  motion/visual  cue 
conflict  mentioned  in  the  introduction.  Further,  notice  that  analytically 
opening  the  loop  for  either  target  or  disturbance  inputs  will  give  different 
apparent  "opened-loop"  describing  functions  (Eqs.  4b  vs.  4c')  even  with  identi- 
cal V and  M operations  in  both  equations.  This  has  led  in  the  past  to  some 
misinterpretation  of  results  for  mostly- target  or  mostly  disturbance  inputs. 

Finally,  it  can  be  seen  that,  knowing  the  vehicle  and  washout  dynamics 
(Yq  and  W)  and  with  simultaneous  independent  inputs  I and  D,  the  independent 
estimates  of  the  visual  and  motion  operations  (V  and  M)  are  theoretically 
possible  if  the  signals  are  not  confounded  with  noise.  The  temptation  to 
measure  V and  M from  static  and  motion-only  runs,  respectively,  is  precluded 
by  the  adaptive  nature  of  the  human  operator.  In  general,  the  pilot  will 
adopt  different  parameter  values  for  his  gains,  leads  and  Isigs  in  the  above 
special  cases  compared  to  the  combined  case,  as  will  be  shown  later. 


Model  Structure  and  Parameters.  — The  criteria  for  selecting  the  model 
structure  were  that  it  be; 

1 , The  simplest  form  capable  of  capturing  all  of  the  significant 
frequency-domain  characteristics  of  the  measured  data,  both 
with  and  without  motion. 

2.  Have  components  structurally  related  to  previously  well  known 
visual-motor  elements,  such  as  neuromuscular  (NM)  and,  central- 
nervous  system  (CNS)  components,  as  well  as  motion  sensing 
elements  from  afferent  vestibular  and  proprioceptive  signals. 

5.  Compatible  with  prior  manual- control  models,  e.g.,  those  in 
Ref.  5. 

Figure  5 details  the  assumed  pilot  model  structure  and  forms  for  the 
Visual  and  Motion  paths  of  Fig.  2.  The  rate  and  displacement  elements  in  the 
"VISUAL  PROCESSES"  group  are  used  to  generate  a lead  time  constant  (Tl  = Kr/ 
Kp)  which  pilots  typically  adopt  to  cancel  the  roll- subsidence  mode  in  the 
controlled  element  (Ref.  5).  The  "integral"  term  is  sometimes  needed  to 
represent  the  pilot's  trimming  actions  and  other  low  frequency  behavior, 
(e.g.,  the  so  called  "a-effects"  in  the  Extended  Crossover  Model  of  Ref.  5) 
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Rote 


Figure  3.  Assvimed  Pilot  Model  for  Roll-Only  Tracking 


The  extra  visual  time  delays  account  for  retinal  and  central  (e.g.,  rate) 
processing  as  well  as  computational  and  display  lags. 

The  tilt,  velocity  and  acceleration  terras  in  the  "MOTION  PROCESSES"  are 
the  simplest  possible  descriptors  of  the  pilot's  use  of  physical  bank  angle. 
These  are  not  intended  to  represent  motion  sensors  directly  although  the 
velocity  term  is  very  similar  to  the  output  of  the  semicircular  canals  over 
the  forcing  function  frequency  region.  The  tilt  angle  cue  Kj  is  actually 
due  to  the  lateral  specific  force  due  to  the  tilted  g-vector. 

The  "ACTUATION  PROCESSES"  include  a time  delay  and  a third  order  neuro- 
muscular system,  the  latter  readily  simplified  to  a second  or  even  a first 
order  approximation,  as  noted  in  the  figure  (e.g.,  for  a second-order  system 
set  Tju  = 0,  whence  Aj  = 0,  Ag  = l/>^N^  and  Ai  = 2^ij/‘'n)‘  The  delay  terms  Ty 
and  were  actually  modeled  as  first-order  Pade  polynomials,  and  by  breaking 
up  the  net  delays  into  two  small  portions  the  Pade  roots  (at  2/t)  are  at 
sufficiently  high  frequency  to  give  an  excellent  fit  up  to  over  10  rad/sec. 
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Identification . — The  two  "opened-loop"  expressions  in  Eq.  4a  can  be 
used  to  identify  the  two  unknown  paths  (Visual  and  Motion)  only  if  the  Target 
and  Disturbance  inputs  are  independent.  For  signals  constructed  as  a sum  of 
sine  waves  this  means  that  there  can  be  no  common  frequencies.  However  this 
precludes  the  direct  solution  for  the  unknowns  (V  and  M)  since  the  "opened 
loop"  expressions  cannot  be  evaluated  at  the  same  frequencies.  This  dilemma 
was  dealt  with  in  Refs.  1 and  2 by  linearly  interpolating  the  measurements 
at  the  interleaved  frequencies.  This  can  lead  to  difficulties  and  inaccura- 
cies in  the  vicinity  of  lightly  damped  modes,  where  the  transfer  functions  are 
not  smooth.  A different  technique  is  used  where  specific  model  forms  are 
assumed  for  the  Visual  and  Motion  paths  and  the  equations  of  motion  are  writ- 
ten for  all  elements  and  loops,  so  that  in  effect  the  "interpolations"  are 
made  with  appropriately  shaped  math  models.  The  unknown  parameters  are  then 
adjusted  by  the  STI  Model  Fitting  Program  (MFP;  described  below)  so  as  to  fit 
simultaneously  the  closed  loop  error  and  stick  describing  function  responses 
to  the  Target  and  Disturbance  inputs. 


The  STI  Model  Fitting  Program  was  developed  to  fit  high  order  mviltiloop 
models  to  frequency  domain  data  (e.g.,  from  Fast  Fourier  transforms  and  is 
described  in  Ref.  7*  It  evaluates  selected  transfer  functions  from  fixed- 
form  adjustable-parameter  equations-of-motion  written  in  a special  way  such 
that  each  adjustable  parameter  appears  only  once  in  the  "matrix- of- equations." 
Thus,  the  influence  of  each  parameter  on  any  system  response  to  any  input  is 
available.  The  program  minimizes  the  vector  difference  between  model  and  data 
transfer  function  responses  using  a variety  of  steepest  descent  techniques  to 
minimize  a cost  function.  This  cost  function  is  evaluated  by  squaring  and 
amplitude  weighting  the  difference  in  the  real  and  imaginary  parts  of  the  data 
and  model  responses.  In  the  present  case,  five  frequencies  of  the  task  error - 
to-disturbance,  four  of  the  stick-to-disturbance  and  five  of  a linear  sum  of 
error-  and  stick- to- target  were  fit.  The  araplitude-v/eighting  was  the  inverse 
of  the  data  magnitude,  thus  each  frequency  was  uniformly  represented  except 
that  the  highest  frequency  of  the  stick-to-disturbance  was  weighted  10  dB  less. 


Since  the  target  and  disturbance  are  svuns  of  sinusoids,  the  effective 
"opened-loop"  ejqjressions  in  Eq.  4 were  estimated  using  ratios  of  Fourier 
coefficients: 


Gi  (jto) 
Gd  (joj) 


II 

/pujt\ 

\wmj 

at  Target  frequencies,  ooj 

(5) 

-C 

Ce 

/-stikI 

\ SERR  j 

1 at  Disturbance  frequencies, 

tD£) 

(6) 

where  the  four  character  names  PLNT,  VERR,  STIK  and  SERR  are  defined  in  Fig.  1 
and  will  be  used  to  identify  various  responses  in  the  remainder  of  this  report. 

To  check  the  accuracy  of  this  procedure  an  analog  "autopilot"  operation  on 
both  task  error  and  measured  motion  was  mechanized  on  the  DES  setup  and  the 
recorded  signals  were  processed  thru  MFP.  Table  5 summarizes  the  resixlts  of 
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TABLE  5.  ORIGINAL  AND  RECOVERED  PARAMETERS 
FOR  DUAL  AUTOPILOT 


+ % --rus 

Visual  Path:  V = ^^4;--  e V 

Motion  Path:  IM  = _ ■ --- 

ImS  + 1 


CASE 

"VISUAL  LOOP" 

"MOTION  LOOP" 

Kd 

% 

Tv 

Tv 

Kiji 

Ky 

% 

Original 

.153 

.067 

.100 

.018 

.040 

.100 

.100 

Recovered 
by  MFP 

.154 

.062 

.098 

.025 

.040 

.104 

.092 

this  check,  using  the  forms  indicated.  The  time  delay  shown  is  an  approxima- 
tion to  the  net  phase  effects  of  various  hybrid  computation  delays  and  high- 
frequency  anti-aliasing  filter  lags.  Some  errors  could  be  due  to  the  fact 
that  the  "dialed-in"  computer  settings  did  not  accurately  represent  the  effec- 
tive parameters.  Generally  the  recovered  parameters  in  Table  5 are  quite  close 
to  the  nominal,  such  that  a transfer  function  plotted  from  the  recovered  para- 
meters would  be  indistinguishable  from  one  plotted  for  the  original  parameters. 


Washout  Dynamics 

In  addition  to  the  static  (no  motion)  case  ("ST"))  and  full-motion  cases 
with  roll  axis  at  0 deg  inclination  "FO",  and  nose  up  90  degrees,  "F90"j 
four  different  washout  schemes  were  tested: 


• Purely  Attenuated,  "A"  wherein  the  plant  motions  at  all  fre- 
quencies were  multiplied  by  l/2  in  commanding  the  DES. 

• First-Order,  "Wl";  where  the  low  frequency  motions  are  attenu- 
ated by  a first-order  high  pass  filter  of  the  form: 


9 W1  s + 1/T 


(7) 
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where 


Khi  = high  frequency  gain  (near  l.O) 

T = time  constant  ("break  frequency"  = l/T) 

With  this  washout  a step  bank  angle  command  returns  e:q)eriraentally  to  zero 
with  a time  constant  of  T sec. 

• First-Order,  Attenuated,  "Wl,A"j  a combination  of  the  two  fore- 
going washouts,  with  different  gains  and  break  frequencies. 

• Second-Order  "W2";  the  low  frequency  terms  are  washed  out  by 
second  order  high  pass  filter  of  the  form 

.r  2 

~ P (8) 

^ W2  s2  + 2^a>s  + tt' 

where 


0)  = the  break  frequency,  and 
^ = the  damping  ratio  (typically  .7) 

With  such  a second-order  washout  an  initial  step  bank  angle  returns  with 
minimal  overshoot  with  an  effective  delay  (to  half  amplitude)  of  (2^/(o) 
seconds.  A constant  roll  rate  input  still  ends  up  at  zero  bank  angle. 

The  various  washout  parameters  were  originally  selected  to  produce  a 
reduction  in  rms  roll  amplitude  to  about  50  percent  of  the  full  motion  case, 
based  on  a more-or-less  arbitrary  a priori  assumption  of  a typical,  invariant, 
second-order  closed- loop  pilot- simulator  response  to  roll  commands,  charac- 
terized by  a bandwidth  of  5.6  rad/sec  and  a closed-loop  damping  ratio  of 
^CL  ^ realized  that  in  practice  the  pilot  might  change  his  re- 

sponse characteristics  for  different  v/ashouts,  but  this  procedure  was  used 
to  select  the  different  parameters  on  a more  rational  basis  than  (say)  fixed 
break  frequencies  of  all  the  washouts. 

In  the  simulation,  inadvertent  problems  with  mechanization  of  the  filters 
and  DES  response  properties  slightly  modified  the  intended  wash-out  dynamics. 
The  actual  response  properties  of  the  washout  plus  DES  combination  were  fitted 
by  the  appropriate  forms  of  Eqs.  7 and  8 and  the  effective  washout-filter 
parameters  were  extracted.  These  are  summarized  in  Table  k.  Most  of  the 
effective  parameters  were  close  to  the  intended  ones,  except  for  the  W2  high 
frequency  gain  which  was  1.2  instead  of  the  1.0  desired.  In  Table  4 the  cases 
are  arranged  in  order  of  decreasing  magnitude  of  rms  physical  roll  angle,  and 
this  order  will  be  used  throughout  the  presentations  to  follow. 


Measurements 

A comprehensive  set  of  measurements  were  made  in  an  attempt  to  quantify 
all  aspects  of  the  pilot's  performance,  behavior,  and  effort. 
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TABLE  4.  MOTION  CONDITIONS  AND  WASHOUT  DYNAMICS 


OgHlli 

0 

ON 

^0 

W2 

Wl 

Wl,  A 

A 

ST 

Washout 

Type: 

"Pull 
Motion" 
at  90° 

"Pull 
Motion" 
at  0° 

"Second 

Order" 

"First 

Order" 

"First 

Order, 

Attenuated" 

"Attenu- 

ated" 

"Static" 

High  Fre- 
quency Gain 

1.0 

1 

1.0 

1.2 

1.0 

0.7 

0.55 

c 

Break 

1 

i 

1 

— 

0)*  .85  r/s 
?=-7 

1 .0  r/s 

.40  r/s 

— 

— 

1 . Perfomance  Measures;  Overall  statistics  (mean,  variance,  rms) 

of  all  signals,  with  emphasis  herein  on:  tracking  error  stick 

force  amd  physical  roll-angle  ajid  rates. 

2.  Pilot  Behavior  Measures;  Describing  functions  are  the  primary 
indicators  of  pilot  behavior.  The  fitted  parameters  are  use- 
ful for  encoding  efficiently  the  data,  but  the  actual  plots 
are  often  most  informative.  We  use  the  "opened- loop"  describ- 
ing function,  as  they  are  the  most  useful  and  tie  in  with  past 
experience  on  single  loop  systems. 

5.  Subjective  Evaluations;  Each  subject  was  given  a questionnaire 
about  his  tracking  strategy,  effects  of  motion  cues  and,  dif- 
ferences due  to  washouts.  Because  these  were  not  e:q)erienced 
pilots,  no  comparison  to  actual  flight  could  be  made;  Instead, 
subjects  were  asked  to  compare  the  motion  cues  with  those  of 
the  P90  "real  world"  case. 


APFABAIUS  AND  PROCEDURES 


Apparatus 

The  experiment  was  performed  on  the  Dynamic  Environmental  Simulator  (DES) 
at  the  Aerospace  Medical  Research  Laboratory  at  Wright-Patterson  Air  Force 
Base.  The  DES  is  a man- rated  centrifuge  with  independent  roll  and  pitch  cab 
control.  For  this  experiment  only  the  roll  tracking  motion  was  used,  with 
the  roll-rate  limited  to  90  deg/sec  and  the  roll  acceleration  limited  to  90 
deg/sec^.  There  are  no  limits  on  roll  angle  in  the  DES. 

Within  the  cab,  the  subject  seat  was  mounted  such  that  the  roll  axis  of 
rotation  was  roughly  through  the  subject's  head.  Mounted  on  the  seat  was  a 
right-side-mounted  force  stick  for  vehicle  control.  The  elbow  was  braced,  so 
that  when  the  roll  axis  was  90  deg  nose  up.  the  hand  was  still  comfortably 
over  the  stick.  The  cab  contained  a computer  generated  display.  Fig.  4, 
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which  was  centered  in  azimuth  a distance  of  approximately  17  inches  from  the 
subject's  eyes.  Subject's  sitting  height  were  such  that  the  display  was  with- 
in 0 to  10  degrees  of  eye  level.  The  "inside-out"  display  of  target  tracking 
error  consisted  of  a 3.5  inch  long  rotating  "target  wing"  whose  center  was 
superimposed  upon  a stationary  horizontal  dashed  line  nine  inches  in  length. 

A .25  inch  perpendicular  "fin"  at  the  center  of  the  rotating  line  provided 
upright  orientation. 


Figure  4.  Sketch  of  the  Roll  Tracking  Display 

The  DBS  is  configured  such  that  the  pitch  gimbal  is  outside  of  the  roll 
gimbal.  Thus  it  is  possible  to  pitch  the  simulator  nose  up  90  degrees  without 
affecting  the  roll  axis  tracking  system.  The  cab  pitched  up  90  degrees  was 
used  for  tne  "real-world"  condition,  as  noted  earlier. 


Ejqperlmental  Procedure 

Four  healthy  college  students  between  l8  and  25  years  of  age  were  used 
for  the  expariraent.  None  were  experienced  pilots,  so  extensive  training  was 
necessary.  Training  was  first  accomplished  for  the  static  and  two  Pull-Motion 
conditions.  Tracking  under  each  condition  was  considered  one  run.  Each  run 
lasted  165  sec  and  the  three  conditions  or  runs  were  presented  in  a random 
order  each  day.  At  the  end  of  each  run,  subjects  were  presented  their  raean- 
squared-error  score  for  that  run.  Training  continued  for  approximately  three 
weeks,  three  to  six  runs  per  day,  at  which  time  error  scores  began  to  reach 
asymptotic  levels.  Once  perfoiroance  leveled  off,  four  more  runs  per  subject 
per  condition  were  performed  and  time  history  data  was  recorded  for  subsequent 
analysis. 

For  the  second  p6irt  of  the  study  in  which  we  investigated  washout  filter 
effects,  we  used  the  ejq)erimental  design  philosophy  stated  earlier  — that 
washout  filter  effects  should  be  compared  to  the  "real-world"  motion  cues 
as  encountered  in  the  full  motion  no-tilt-cue  case  (F90).  Therefore  at  the 
start  of  the  evaluation  of  each  washout  filter,  we  let  each  subject  first 
track  in  the  F90  condition  for  one  day.  Following  this  we  had  each  subject 
track  normally  (roll  axis  at  0 deg)  with  a given  washout  filter  for  three 
days,  four  runs  per  day.  The  last  four  runs  for  each  subject  with  the  washout 
filter  were  saved  for  data  analysis.  The  procedure  was  followed  for  each 
washout  filter  investigated.  As  in  the  first  part  of  the  study,  subjects  were 
told  their  scores  for  motivational  purposes. 
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Data  Collection 


A hybrid  computer  system  was  used  for:  display  generation,  forcing  func- 

tion creation,  on-line  error  score  computation,  and  time  history  data  collec- 
tion. From  the  time  history  data,  root-mean- squared  values  and  Fast  Fourier 
Transforms  (FFT)  of  each  time  signal  were  computed.  From  the  FFT's  power 
spectral  densities  and  opened- loop  describing  functions  (e.g.,  Eqs.  7 and  8) 
were  computed.  The  frequency  response  data  reduction,  baaed  upon  the  sum  of 
sine  waves  generation,  was  similar  to  that  employed  in  a preceding  study 
(Ref.  3). 

Comparisons  among  individual  data  showed  good  c'  nsistency,  once  sufficient 
training  had  occurred.  Therefore,  for  each  motion  condition,  the  last  four 
runs  of  every  subject  were  averaged  (l6  runs  tctal)  by  AMRL  to  give  mean  ± 
standard  deviation  values  for  model  fitting  by  STI.  It  is  these  averaged 
data  that  are  analyzed  in  the  following  section  on  Results. 


RESULTS 

Limited  space  precludes  the  presentation,  here,  of  all  the  reduced  and 
averaged  data.  Instead  we  present  typical  time  histories  for  one  subject, 
averaged  spectra  and  describing  functions  for  a typical  motion  case,  and  then, 
after  demonstrating  that  the  fitted  transfer  functions  truly  represent  the 
data,  we  present  the  "c pened-loop"  curves  for  various  cases,  and  analyze  the 
resulting  performance  and  behavioral  measures  to  answer  the  questions  in  the 
Introduction. 


Typical  Time  History 

A pair  of  time-histories  of  the  various  inputs  and  outputs  for  corres- 
ponding segments  of  static  and  full-motion  runs,  is  given  in  Fig.  5-  For 
these  plots,  identical  target  and  disturbance  inputs  (top  and  bottom  traces) 
were  used  in  each  run,  to  reveal  the  differences  more  clearly.  The  following 
features  of  the  time  histories  should  be  noted: 

• The  disturbance  input,  which  is  summed  downstream  of  the 
stick  (and  shown  to  the  same  scale)  is  effectively  integrated 
by  the  vehicle  dynamics  to  yield  roll  motions  comparable  in 
amplitude  and  frequency  to  the  target  input. 

• In  the  static  case  the  roll  angle  does  not  follow  the  target 
very  well,  because  of  these  simultaneous,  large  disturbance 
inputs. 

• Comparison  of  the  E and  C traces  for  the  static  case  (where 
only  the  visually  displayed  error  can  be  used)  shows  that 
the  pilot  is  using  both  error  displacement  and  rate  in  his 
compensating  ccntrol  actions. 
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• Comparing  the  motion  case  to  the  static  case,  the  control 
response  is  obviously  a more  aggressive  and  higher  band- 
width (due  to  motion  cues),  while  the  tracking  error  is 
reduced. 

• (Not  shown)  There  is  a remarkable  consistency  in  the  q>, 

E and  C traces  for  repeated  portions  of  the  same  Inputs, 
showing  a highly  input- coherent  and  consistent  operator 
response,  as  will  be  shown  by  the  reduced  data,  later. 


Frequency-Domain  I.ata 

Examination  of  the  individual  error  scores  and  closed-loop  describing 
functions  showed  that  each  of  the  subjects  adopted  similar  behavior  and  so 
the  results  could  be  validly  averaged,  without  loss  of  significant  details  in 
the  average.  Thus,  approximately  four  runs  each  of  four  subjects  were  aver- 
aged for  the  data  shown  (a  few  runs  were  dropped  due  t data  problems).  The 
data  shown  here  for  the  Full  Motion  Case  with  roll  axis  at  0 degrees  (FO)  is 
genuinely  typical  of  all  the  cases  investigated  and  was  not  selected  as  the 
best-examples  available. 

Spectra.  — Figiire  6 shows  power  spectra  for  the  control  stick,  displayed 
error,  and  aircraft  bank  angle.  The  remnant  shown  (plotted  at  forcing  func- 
tion frequencies  by  the  X symbols)  is  actually  an  average  over  neighboring 
(non- overlapping)  estimates.  The  small  standard  devlntlms  shown  for  all  sig- 
nal components  indicate  that  all  subjects  had  essentially  the  same,  low  vari- 
ability, behavior.  The  signal-tc-ncise  ratio  is  quite  good  at  all  but  the 
very  highest  frequencies  and  implies  a high  coherency  between  the  two  inputs 
and  responses.  This  permits  the  major  part  of  the  responses  to  be  described 
by  linearized  describing  functions.  Notice  that  the  spectrum  of  ^piant 
is  large  at  low  target  frequencies  (to  follow  the  target)  while  its  spectrum 
at  low  disturbance  frequencies  (0)  is  lower,  as  desired. 

Closed- Loop  Describing  fXtnctions.  — Figure  7 illustrates  typical  closed- 
loop  describing  function  date  (to  which  the  model  was  fitted  by  the  MFP  pro- 
cedure described  earlier)  for  the  control  stick  and  task  error  responses  to 
trrget  and  disturbance  inputs.  The  frequencies  used  in  the  model  fits  are 
indicated  by  the  arrows  labeled  "Fitted  Freqs".  Not  all  data  points  were 
used  for  computational  economy.  A preliminary  analysis  indicated  that  the 
selected  frequency  response  points  were  the  most  sensitive  Indicators  of  pilot 
behavior. 

Generally,  the  closed- loop  data  e:d\lblt  very  low  variability  and  the  model 
fits  capture  every  nuance  of  all  the  responses,  using  one  set  of  model  para- 
meters and  the  various  closed- loop  relationships  (e.g.,  in  Fig.  2).  The 
wiggles  in  the  describing  functions  due  to  various  low-damped  modes,  would 
greatly  complicate  simple  interpolations  between  target  frequencies  to  obtain 
vectors  at  disturbance  frequencies,  as  done  by  earlier  Investigators  (Refs.  i 

Model  Fits.  — Table  5 summarizes  the  model  parameters  fit  to  the  data  fur 
all  dual-input  cases.  Only  nine  of  the  twelve  parameters  in  Fig.  3 were 


481 


Phase  (deg)  Amplitude (dB)  Phase  {deg)  Amplitude  (dB) 


TARGET  INPUT 


DISTURBANCE  INPUT 


i Target  Input  Data  (±l<r)  | Average  4Ss, 

5 Disturbance  Input  Data  (tier)  1 4 Runs  Each 
Model  Fits 

ORIGINAL  PAGE  IS 
OP  POOR  QUALITY 

Figure  7,  Typical  Closed  Loop  Describing  Function  Data  and  Model  Fits  for 
Full  Motion,  Erect  (Dual  Input,  Case  FO) 
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TABLE  5.  SUMMARY  OF  MODEL  PARAMETERS  FIT  TO  DATA 


CASE 

Motion 

Condition 

MODEL  PARAMETERS 

REMARKS 

Visual 

Motion  j 

Neuromuscular 

Kd 

Kr 

Tv 

Kr 

Ko 

% 

iCj, 

Kv 

Ka 

Sn 

0)N 

TW*-Ai 

lb 

deg 

lb 

sec 

sec 

sec 

lb 

deg 

lb 

lb 

sec 

1 

1 

rad 

sec 

sec 

deg/s 

deg/s 

deg/s2 

P90 

Real  World 

0.149 

0.068 

0.16 

0.46 

0.50 

-.0001 

0.076 

0.020 

0.15 

0.26 

9.3 

0.20 

Theor.  Kj  » 0 

FO 

Pull  Motion 

C.156 

0.074 

0.15 

0.54 

0.59 

0.022 

0.070 

0.022 

0.15 

0.29 

10.4 

0.20 

Tj^  A-|  = Effec- 
tive Delay 

W2 

2nd  Washout 

0.134 

0.090 

0.12 

0.67 

0.55 

0.023 

0.048 

0.019 

c.n 

0.39 

a 

0.22 

W1 

1st  Washout 

0.130 

0.079 

' ' ' 

0.49 

0.034 

0.060 

0.022 

0.11 

0.58 

m 

0.21 

Wl,  A 

1st  Wash  Atten. 

0.119 

0.070 

0.040 

0.081 

0.031 

0.17  ' 

0.28 

9.0 

0.23 

A 

Atten.  Motion 

0.122 

0.055 

0.06 

0.45 

0.57 

0.056 

0.151 

0.028 

0.15 

C.15 

8.2 

0.19 

K«r>  Ky  twice 
Values  for  FO 

ST 

Static 

0.072 

0.064 

1 

— 

0.89 

— 

■—  i 

— 

— 

0.18 

0.18 

0.25 

(K, , P^,  Aj  set  to  0) 


needed,  as  preliminary  fits  showed  that  a second  order  fit  was  sufficient  for 
the  neuromuscular  mode  (Ty  = O)  and  there  appeared  to  be  no  error  integrating 
action  (Ki  = Pi  = O).  Lack  of  Ki  and  Pj  (the  so  called  o^-effect  in  the  Exten- 
ded Crossover  Model)  may  have  been  due  to  presence  of  the  tilt  cue  in  the 
motion  cases  with  roll  axis  at  C deg,  but  its  absence  at  F90  and  Static  con- 
ditions is  unusual. 

The  additional  colmns  in  Table  5 detail  the  effective  lead  time  constant 
in  the  visual  path  (Tl  = Kr/Kp)  and  the  effective  time  delay  in  the  neuro- 
muscular path  ( Te  = Tjtj  + Ai ) . Note  that  the  visual  d.i  splacement  gain,  Kp, 
nearly  doubles  when  going  from  Static  to  any  Motion  condition,  and  the  tilt 
sensitivity,  KT,  is  negligible  for  the  F90  case,  as  it  should  be,  since  no 
tilt  cue  is  available. 

Opened- Loop  Describing  Functions.  — A number  of  other  trends  and  co- 
variations among  parameters  are  evident;  however,  these  effects  can  best  be 
illustrated  by  using  the  "opened- loop"  responses  calculated  using  the  measured 
closed- loop  data  along  with  the  loop  structure  of  Fig.  2 or  the  parameters  in 
Table  5 with  the  model  of  Figs.  2 and  5.  Figure  8 shows  the  resulting  "opened 
loop"  data  and  computed  model  curve  for  the  Pull  Motion,  FO  Case.  As  with 
the  closed  loop  responses  the  model  curve  fits  the  actual  "opened- loop"  data 
very  well  — it  truly  represents  the  data.  These  data  and  fits  for  this 
example  are  typical;  i.e.,  the  other  cases  show  effects  similar  in  kind, 
differing  only  in  degree.  Thus,  comparisons  among  cases  can  be  made  using 
the  curve  fits,  as  we  will  do  in  the  remainder  of  this  paper. 

These  multiple  "opened- loop"  describing  functions  have  all  of  the  appear- 
ance and  significance  of  single  open-loop  transfer  functions,  and  similar  des- 
criptive parameters  apply.  Some  of  these  have  been  noted  on  Fig.  8,  as  defined 
below: 

= "unstable  frequency"  (180  deg  phase  crossover).  This 
sets  the  maximum  bandwidth  of  the  loop,  and  is  the 
frequency  at  which  oscillations  set  in  if  the  gain 
were  further  increased  by  dB. 

(Dc  = "crossover  frequency"  (O  dB  gain  crossover).  This 

sets  the  effective  bandwidth  of  the  loop,  and  deter- 
mines the  resulting  stability  margins. 

% = "gain  margin"  — allowable  gain  increase  for  incipi- 
ent loop  instability. 

cpj^  = "phase  margin"  — allowable  phase  lag  for  incipient 
loop  instability. 

In  Fig.  8,  it  is  apparent  that  the  disturbance  loop  (dominated  by  the  motion 
pathway)  has  a higher  bandwidth  and  lower  phase  margin  than  the  target  loop 
(dominated  by  the  visual  pathway) . This  implies  lower  tracking  errors,  as 
will  be  shown  later. 
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Figure  8.  Typical  Effective  "Opened  Loop"  Data  and  Model  Curve 
for  Full  Motion,  Erect  (Dual  Input,  Case  FO) 
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The  kinks  in  the  dashed  "asymptctes"  in  Fig,  8 show  the  poles  (break 
downwards)  and  zeroes  (break  upward)  of  the  model.  The  need  for  the  rela- 
tively high  order  pilot-vehicle  model  used  here  is  clearly  shown  by  the 
spread  between  the  asymptote  breaks  and  the  model  fits  as  well  as  the  dif- 
ferent asymptotes  in  each  "opened- loop." 


Effects  of  Full  Motion  vs.  Static  Conditions 

Figure  9 compares  various  performance  measures  for  Full  Motion  and  Static 
cases.  Variances  are  used  because  they  can  be  partitioned  into  summable  vec- 
tor components  due  to;  Target,  Disturbance  and  Remnant.  Concentrating  on 
task  error.  Fig.  9^,  for  the  STATIC  Case,  the  error  components  from  Disturbance 
(D)  and  Target  (T)  inputs  are  essentially  the  same,  reflecting  the  dual  input 
spectrum  design  objective  mentioned  earlier.  For  the  Full  Motion  at  90  deg 
(F90)  case  the  target  errors  (T)  are  the  same  as  for  a Static  cab,  while  the 
disturbance  errors  (D)  are  much  smaller.  Going  from  Pull  Motion,  at  90  deg 
to  the  0 deg  (FO)  case  shows  that  the  target  following  errors  (T)  are  reduced 
slightly  while  the  disturbance  errors  are  unchanged. 

These  basic  trends  in  the  tracking  performance  are  explained  by  the 
changes  in  the  opened- loop  describing  functions  (DF)  shown  in  Fig.  10.  For 
the  Target  Input  DFs  the  Supine  and  Static  cases  having  no  tilt  cues  show 
essentially  the  same  DF  (which  results  in  the  same  target  following  errors) 
whereas  the  Erect  case  (with  the  maximum  tilt  cue)  has  a smaller  target  error. 
For  the  Disturbance  Input  DF  both  motion  cases  (FO,  F90)  have  the  same  DF, 
which  explains  why  their  "D"  components  were  the  same  in  Figs.  9^'>b,c,d. 
Furthermore,  the  "Rate  Cue  Effect"  (lower  loop  lags  leading  to  higher  cross- 
over frequencies  with  motion)  leads  to  the  motion/static  perfomance  effects 
denoted  by  the  arrows.  Thus  Figs.  9 £>-cd  10  show  that  the  subjects  used  motion 
cues  to  improve  performance  in  two  main  ways. 

• The  lower  lags  (and  higher  (Ou)  permitted  by  the  vestibular 
sensory-motor  loop  enables,  in  effect,  a "roll-rate  damper 
loop"  to  be  closed  by  the  pilot,  thereby  allowing  a tighter 
disturbance  regulation  loop  to  be  used  by  him  (a  loop  gain 
increase  of  about  2. 7/1.7  = 1.6).  Consequently,  the  dis- 
turbance variance  is  reduced  significantly. 

• The  tilt- cue  was  used  at  low  frequencies  to  provide  a sense 
of  zero  reference  and,  thereby,  to  avoid  drifts  and  over- 
shoots, the  effects  showing  up  as  a low  frequency  phase 
reduction  on  the  target  "opened- loop." 


Components  of  the  Moltlloop  Describing  Function  Under  Motion 

Further  insight  may  be  gained  into  the  complexity  of  the  multiloop  inter- 
actions and  motion  effects  via  Fig.  11,  in  which  the  fitted  model  has  been 
used,  via  the  loop  structure  and  equations  of  Fig.  2,  to  examine;  each 
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a)  ROLL  ANGLE 


b)  TASK  ERROR 


Variance 


RMS 


Legend: 

F90  * Full  Motion.SupIne ; FO*  Full  Motion, Erect;  ST*Static 
Components  due  to : T « Target , D > Disturbance , R > Remnant 
Average  of  4 Ss , 4 Runs  Eoch 


Figure  9*  Effects  of  Pull  Motion  (Supine,  Erect)  and 
Static  Cases  on  Performance 
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Figure  10.  Effect  of  Motion  Cues  on  "Opened  Loop" 
Describing  Functions  (Dual  Input  Cases) 
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sensory  loop  individually  (visual  = dashed,  motion  = dotted)  with  the  other 
simply  turned  off,  suid  then  the  combined  "opened-loop”  (solid  line)  as  dis- 
cussed earlier  in  Section  II-C.  Remember  that  the  "opened-loop"  DF  is  a com- 
plex vector  function  of  V and  M,  as  noted  in  the  legend. 

Without  going  into  details,  the  key  points  revealed  by  Fig.  11  are  as 
follows : 

• The  Disturbance  Input  loop  (on  right)  is  a simple  vector  sum 
of  VYq  and  MYc*  The  flat  amplitude  of  the  motion  loop  (dotted) 
shows  that  MY^  acts  like  a roll-rate  feedback  loop  with  an  effec- 
tive time  delay,  te,  appreciably  less  than  the  visual  loop  (for 
MYc>  Tg  = .20  sec,  for  VYg}  Te  = *20  + .15  = ♦55s).  Over  the 
important  crossover  frequency  region  of  O.5-5.O  r/s,  their  vec- 
tor sum  (solid)  has  an  apparent  Tg  even  less  than  MYg  alone  I 
This  is  consistent  with  and  "explains"  the  results  of  Stapleford 
(Ref.  1)  and  Shirley  (Ref.  2). 

• At  low  frequencies  the  Disturbance  regulation  (solid)  is 
dominated  by  (closest  to)  the  visual  loop  at  low  frequencies 
and  motion  loop  at  high  frequencies. 

• The  Target  following  loop  (on  the  left)  is  a more  complex 
function  of  VYc  and  MYg  as  seen  in  the  equations  in  the  box. 

(The  motion  component  u + YcM)~^  is  shown  dash-dotted  to 
distinguish  it  from  YgM  alone.  Here,  the  solid  curve  is  the 
vector  product  of  the  two  components).  In  both  amplitude 
and  phase,  the  Target  following  loop  dynamics  are  dominated 
by  the  visual  loop  (dashed)  at  all  frequencies. 

• A comparison  (not  shown  here)  of  the  purely  visual  static 
case  per  se  (dotted  curve  of  previous  Fig.  10)  and  the 
isolated  VYg  (dashed  curve  of  Fig.  11 ) shows  that  they 
are  not  the  same.  When  motion  is  present,  the  visual 
loop  can  be  (and  is)  operated  at  higher  gains,  albeit 
with  a slightly  larger  lead  equalization  (Tl)  and  con- 
sequently larger  xg.  (Per  Table  5,  Tj,  A 0.89  sec  and 

Te  = 0.23  sec  for  the  ST  case;  while  Tl  = 0.5*^  sec  and 
Tg  = 0.20  + 0.15  = 0.35  sec  for  the  FC  Case). 

This  analysis  of  Fig.  11,  and  others  like  it,  clearly  shows  that  one  can- 
not simply  add  a motion  feedback  loop  to  the  static  case  dynamics  to  get  the 
combined  result.  Instead  the  operator  optimizes  his  combined  loop  properties 
for  the  case  at  hand. 


Bffects  of  Single  vs.  Dual  Forcing  Functions 

For  some  F\ill  Motion  cases  (F90,  FO),  data  were  taken  for  Target  input 
alone;  and  for  Case  F90,  Disturbance  input  alone,  to  compare  with  the  dual 
input  case.  When  either  input  was  used  alone,  it  was  increased  by  the  square- 
root-of-two  to  keep  the  rms  input  the  same  as  in  the  dual  input  case. 
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In  general  one  might  expect  that  If  the  distiorbance  alone  were  present, 
the  pilot  would  adopt  a different  optiimun  behavior,  because  all  he  would  have 
to  do  is  to  suppress  both  the  felt  and  seen  motions.  Conversely,  for  the  tar- 
get alone,  the  pilot  might  more  agressively  track  the  error,  because  the  un- 
seen disturbances  were  absent. 

The  results,  shown  in  the  opened- loop  describing  functions  in  Fig.  12,  did 
not  follow  these  expectations'.  For  simplicity,  the  curve  in  Fig.  12  is  that 
fitted  to  the  corresponding  dual  input  case,  for  which  it  passed  precisely 
thru  every  data  point  on  both  sets  of  DF  (e.g.,  see  Fig.  8).  The  single- input 
data  are  shown  relative  to  this  dual-input  curve  in  Fig.  12,  remembering  that 
each  of  the  data  plots  represents  a different  set  of  runs.  Somewhat  to  our 
surprise,  the  single  input  data  are  not  significantly  different  from  the  dual 
input  case,  for  the  points  generally  lie  within  one  symbol  width  of  the  curve 
and  almost  all  lie  well  within  ± 1 standard  deviation  of  the  dual-input  curve. 

How  can  this  be,  in  the  light  of  the  theoretical  e3q>ectations  discussed 
above,  considering  that  all  pilots  were  given  plenty  of  practice  on  every 
case,  and  noting  that  all  behaved  similarly  (evidenced  by  the  low  scatter)? 

Some  hypotheses  are: 

• The  "optimum"  behavior  was,  perhaps  fortuitously,  nearly 
identical  for  the  single  and  dual  input  cases.  The  combina- 
tion of  lightly  damped  modes  in  the  controlled  element  near 
the  neuromuscular  modes  plus  stick  lags  has  been  identified 
as  the  so-called  "Pilot  Induced  Oscillation  Syndrome"  of 
Ref.  8.  These  restrict  the  degree  of  equalization  which 

can  be  used  by  the  pilot  to  improve  performance.  Consequently, 
he  may  be  operating  near  this  constrained  limit  in  all  cases. 

• The  pilots  were  so  overtrained  in  the  dual  case  that  they  did 
not  adapt  "optimum"  behavior  in  the  single  input  cases  despite 
plenty  of  practice  with  it.  If  so,  this  raises  questions 
with  respect  to  the  assumption  that  pilots  adopt  an  "optimum" 
behavior. 

• There  was  some  error  in  the  ejqjeriroent,  such  that  dual  inputs 
were  really  present.  We  checked  this  and  verified  that  only 
the  specified  single  input  spectra  and  rms  signals  were  present. 

Here  is  an  ideal,  simple  test  case  against  which  to  validate  the  optimal 
adaptation  models  (e.g..  Ref.  4).  The  inputs  are  analytically  tractable,  the 
good  model  fits  show  that  the  data  are  representable  by  linear,  modest-order 
state  equations,  and  the  data  are  precise,  have  high  signal-to-noise,  and  are 
internally  self  consistent.  Such  a validation  remains  as  a future  task. 

Meanwhile,  this  result  tentatively  implies  that  the  dual- input  results 
should  apply  to  the  single  input  situations,  if  the  inputs  and  controlled 
elements  are  similar  to  those  used  herein. 
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Eft9ct§  of  Motion  Shaping  (Washouts) 


Having  presented  the  results  on  our  first  question  — that  of  basic  motion 
effects  vs.  no  motion,  we  turn  now  to  the  second  question;  What  are  the  ef- 
fects of  various  motion  "shaping"  (attenuations  and/or  washouts)?  For  this 
purpose,  the  data  will  be  restricted  to  the  dual- input  cases,  all  with  roll 
axis  horizontal,  i.e.,  FO,  W2,  Wl,  WlA,  ATT,  in  the  order  of  decreasing  recov- 
ered roll  angle. 

Figure  l5  shows  various  performance  measures  for  these  cases. g Consider 
first  the  variance  of  recovered  (measured  physical)  roll  angle,  shown  at 

the  upper  left,  each  case  broken  down  in  terras  of  the  components  due  to  target, 
disturbance  and  remnant.  Noted  on  the  margin  are  the  variances  for  the  target 
(or  disturbance)  alone,  and  their  sum.  Ideally,  the  recovered  variance  would 
consist  of  only  the  target  component  (equal  to  Oq)|>  attenuated  by  the  motion 
shaping  washout)  and  no  disturbance  or  remnant  portions.  It  may  be  recalled 
from  Fig.  9 that  in  the  (real-world)  "F-90”  case  this  ideal  is  approached,  in 
thvt  the  target  component  nearly  equals  the  commands,  while  the  disturbance 
and  remnant  portions  were  small  fractions  of  that. 

With  these  standards  in  mind,  let  us  consider  the  effects  of  various  wash- 
outs. As  described  in  Section  II  on  Experimental  Design,  the  overall  scheme 
was  to  select  different  forms  of  motion  washout,  each  selected  (albeit 
crudely)  tc  give  the  same  attenuation  of  roll  angle  tc  about  50  percent  of  the 
basic,  FO,  case  (i.e.,  the  target  roll  variance  of  l/4  of  the  basic  level). 

As  seen  in  Fig.  l5a,  this  was  achieved  closely  only  for  the  pure  attenuation 
case  (orpM  » 5.6  deg  vs.  =7.0  deg).  The  ATT  computed  roll  motions  (shown 
dashed)  were  nearly  equal  to  the  FO  ease,  as  were  the  other  task  performance 
measures  in  Fig.  15  (e.g.,  tracking  error  and  control  force)  implying  a close 
matching  of  the  visual  and  motion- loop  behavior  in  the  basic  and  ATT  cases, 
despite  the  lower  magnitude  of  motion  cues  in  the  latter.  (More  on  this  later). 

The  Second  Order  Washout  (W2)  (which  greatly  attenuates  the  lowest  frequen- 
cies) distorted  the  perceived  motion  cues  (per  the  subjective  questionnaire) 
and  failed  to  reduce  the  motions  as  intended.  Analysis  of  these  results  showed 
that  this  was  due  ti  the  following  reasons: 

a.  The  washout  was  a compromise  design*  such  that  the  high-frequency 
asymptote  magnified  the  roll  angles  (and  rates)  above  the  break 
frequency  of  .85  r/s  by  a factor  of  about  1 .2,  causing  the  roll 
rate  variance  (Fig.  l3-c),  and  high  frequency^ortions  of  the 
roll  angle  variance,  to  be  increased  by  (i.2)~  » 1.4  relative 
to  the  intended  case. 


* The  DES  is  a velocity  system  and  as  such  would  drift  whenever  a cascade  wash- 
out was  used.  Consequently,  a feedback  scheme  was  devised  that  approximated 
the  desired  cascade  washout  but  a perfect  match  at  bth  high  and  low  frequen- 
cies was  not  possible. 
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Figure  15,  Effecta  of  Motion  Shaping  on  Performunce 
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b.  The  distortion  of  the  felt  motions  relative  to  the  visual 
motions  caused  the  pilots  to  perform  even  worse  than  in  the 
static  case. 

The  other  washouts  were  intemediate  in  recovered  motion  and  plant  motion  be- 
tween the  Full  and  Attenuated  cases. 

Attenuation  reduces  both  the  recovered  roll  angles  and  roll  rates  in  the 
same  proportion,  but  washout  reduces  mainly  the  low  frequency  components  and, 
thereby,  reduces  the  roll  rates  less  than  the  roll  angles.  This  can  be  seen 
by  comparing  Pigs.  I3a  vs.  I5c  for  the  W2  and  W1  cases,  especially. 

Except  for  the  anomalous  W2  case,  discussed  above,  the  performance  meas- 
ures of  tracking  error  and  control  force  were  not  significantly  different  among 
any  of  the  first  order  or  attenuated  wash  out  cases  (See  Figs.  l5b  and  l3d. 

Even  the  proportions  of  each  variance  due  to:  target  inputs,  disturbances, 

and  remnant  were  about  the  same  as  for  the  full  motion  case  (FO). 

Further  insight  into  the  pilot's  tracking  behavior  under  these  washouts 
is  given  by  the  opened- loop  describing  functions  in  Pig.  lk.  It  is  immediately 
apparent  that  the  disturbance-loop  describing  functions  are  nearly  identical, 
implying  the  following: 

• Despite  attenuated,  reduced- low- frequency  motions,  and  phase 
distortions,  the  pilot  compensated  to  give  the  same  opened- 
loop  DF. 

• In  the  ATT  case,  the  rms  roll  angle  was  reduced  from  7 deg 

to  3.6  deg,  the  pilot  had  double  his  tilt  and  roll  rate  gains, 

(Kf,  Ky)  as  verified  by  the  fitted  coefficients  in  Table  5, 
and  summarized  below: 


Case; 

<^(p 

% 

% 

Ka 

FO 

7° 

.022 

.070 

.022 

ATT 

3.6° 

.056 

.131 

.028 

Ratio;  (ATT/FO) 

•51 

2.55 

1.87 

1.27 

Despite  the  fact  that 

the  rms 

tilt 

angle  in  the 

ATT  case 

represents  a lateral-specific- force  cue  of  less  than 
3.6/57*3  = .063  gy,  the  roll  rates  were  apparently  suffi- 
ciently high  to  be  readily  sensed  and  used  to  compensate 
for  the  reduced  motion  cue  over  the  FO  case. 

On  the  left  of  Fig.  ik  is  the  target-loop  DF,  where  the  following  effects 
of  washout  are  clearly  apparent: 

• the  FO  and  ATT  cases  are  nearly  identical  for  the  same 

reasons  given  above  for  the  invariant  disturbance  loop  DF. 
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Figure  1^<-.  Effects  of  Motion  Shaping  for  "Opened  Loop"  Describing 
Function  (Dual  Input  Cases,  Roll  Axis  Horizontal) 
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• the  other  washouts  induce  (at  low  frequencies)  higher  ampli- 
tude ratio  and  more  phase  lag  as  the  washout  degree  is  in- 
creased from  ATT^  to  W2.  An  analysis  indicates  that  these 
trends  reflect  fairly  complex  interactions  similar  to  that 
of  Fig.  11  (Left  side).  Note  that  inserting  a low  frequency 
washcat  to  the  motion  path  (M  in  Fig.  1l)  causes  the  result- 
ing curve  to  start  (at  low  frequencies)  on  the  dashed  curve 
and  transition  to  the  solid  curve  with  increasing  frequency. 
These  amplitude  and  phase  trends  explain  the  "Washout  Effect" 
in  Fig.  ill-. 


Optimum  Washout 

One  of  the  objectives  of  this  experiment  v?as  to  find  the  optimum  washout 
for  AMRL’s  roll-only  simulators.  The  desirable  criteria  are  relative  to  the 
"real-world"  case;  a)  significant  reduction  in  roll  amplitude  and  rates,  and 
b)  similar  pilot  behavior  and  performeince . 

Inspection  of  the  foregoing  results  reveals  that  the  clear  choice  is  the 
first-order  attenuated  washout  (WlA).  Figure  15  justifies  this  selection 
based  on  the  following  comparisons  with  the  F90  ("real-world"  baseline)  case; 

• Large  reduction  is  recovered  roll-angle  and  rate  — as 
shown  in  Fig.  15a  — with  similar  plant  roll  angles  and 
rates. 

• Very  similar  tracking  error  performance  and  control  activity, 
as  shown  in  Fig.  15h  and  15c.  EVen  the  distributions  of  each 
variance  from  target,  disturbance,  and  remnant  inputs  is 
closely  matched. 

• The  opened-loop  describing  functions,  shown  in  Fig.  15d, 
are  practically  identical.  This  is  because  the  effect  of 
tilt  cue  usage  previously  described  in  connection  with 
Fig.  10,  is  almost  exactly  cancelled  by  the  washout-break 
effect  noted  in  Fig.  l4. 

• (Not  shown)  The  subjective  comments  were  more  favorable 
for  this  washout  than  any  other  except  pure  attenuation. 

Thus,  we  recommend  first-order  attenuated  washout  for  use  on  all  AMRL  roll- 
only  type  simulators.  The  degree  to  which  this  form  can  be  extended  has  not 
been  determined,  but  the  data  suggest  the  following  as  likely  to  be  both  use- 
ful and  satisfactory  to  pilots: 

• Attenuation  factor  of  0.5  to  0.7 

• Break  frequency  of  0.3+  to  0.5  rad/ sec  (Washout  time-constant 
of  2-5  sec) . 
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Figure  15  • Comparison  of  Optimum  Washout  with  "Real  Worli’"  Case 
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CONCLUSIONS 


This  research  has  covered  several  very  well  trained  subject's  responses  to 
a variety  of  motion  cases  in  a roll-only  motion  simulator,  with  simultaneous 
target  and  disturbance  inputs.  Ihe  results  presented  here  support  the  follow- 
ing conclusions: 

1 . Across  all  seven  conditions  the  four  subjects  were  very  consis- 
tent in  their  tracking  behavior  and  scores,  providing  an  excep- 
tionally, reliable,  and  definitive  data  base  worthy  of  detailed 
analysis,  even  beyond  that  performed  herein  (e.g.,  on  remnant 
effects) . 

2.  The  multiloop  model  structure  presented  in  Fig.  1,  which  has 
both  visual,  motion  and  (a  common)  neuromuscular  dynamic  ele- 
ments, proved  capable  of  accurately  fitting  the  closed-  and 
"opened"-loop  describing  functions  at  all  measurable  signal 
points  within  the  loop.  In  combination  with  the  interleaved 
sum-of-sinusoids  target  and  distvirbance  inputs  the  new  STI 
Multiloop  Fitting  Program  (MFP)  provided  efficient  fits  of 

10  parameters  in  a multiloop  situation  which  had  heretofore 
been  very  difficult  to  fit  because  of  the  complex  interactions 
involved  between  the  visual  and  motion  feedback  paths. 

3.  Untangling  the  closed-multiple  loop  describing  function  data 
in  the  "opened- loop"  manner  shown  here  provides  a ready  com- 
parison with  traditional  single  open- loop  data.  Similar 
effects  (e.g.,  the  Crossover- law  adaptive  behavior)  are 
shown  for  the  dual  input  case,  with  the  disturbance  loop 
having  the  higher  bandwidth  (limited  mainly  by  the  controlled 
element  and  vestibular  rate-sensing  dynamics). 

k.  After  lots  of  analysis  and  digesting  of  complex  trends  in 
the  various  cases,  the  key  to  understanding  it  all  seems  to 
be  the  following: 

• Given  reasonable  rate  motion  cues  at  frequencies 
above  about  0.5-1 .0  rad/sec,  the  pilot's  motion 
feedback  system  acts  like  an  adaptive  roll-rate 
damper  with  a bandwidth  of  nearly  3 rad/sec.  This 
tends  to  suppress  disturbances  but  opposes  target 
following  motions,  while  stabilizing  both  loops. 

• The  pilot  then  uses  sufficient  extra  visual  com- 
pensatory (error  correcting)  gain  to  follow  target 
commands  as  well  under  motion  as  in  the  static 
case,  and  with  less  remnant  and  disturbance  com- 
ponents . 


iOO 


5.  The  affects  of  motion  are  consistent  with  the  prior  work 
of  Stapleford  (Ref.  l),  Shirley  (Ref.  2)  and  Levison  et  ^ 

(Ref.  k),  while  extending  this  work  to  the  new  case  of 
equally  strong  target  and  disturbance  inputs  each  having 
comparable  apparent  spectra  at  the  display. 

6.  Kie  describing  functions  and  fitted  tilt-cue  parameter 
clearly  showed  that  the  spurious  tilt  cues  from  rolling 
with  roll-axis  horizontal  are  used,  even  though  the  rms 
lateral  specific  force  was  in  some  cases  much  less  than 
0.1  gy.  A very  simple  model  for  the  use  of  this  cue  is 
given.  Nevertheless,  use  of  this  cue  resulted  in  only 
small  improvements  in  tracking  performance  in  this  random- 
input  tracking  task. 

7«  The  fotir  types  of  motion  washout  investigated  ( second- order, 
first-order,  first-order-attenuated,  and  purely- attenuated) 
showed  distinct  effects  compared  to  the  "real-world"  refer- 
ence case  of  full  motion  about  a vertical  roll  axis;  the 
second-order  case  was  the  least  desirable  because  of  large 
differences  in  performance,  behavior,  (describing  functions) 
and  subjective  ratings.  The  other  cases  provided  rou^ly 
similar  performance  measures  with  some  small  differences  in 
relative  remnant,  describing  functions,  and  ratings. 

8.  The  pilots  clearly  adapted  differently  to  the  various  wash- 
outs, thus  complicating  the  job  of  predicting  the  net  effects 
for  a given  washout. 

9.  The  optimum  washout  for  roll-only- simulators  (from  the  stand- 
point of  performance,  behavior  and  ratings  similar  to  the 
"real-world"  reference  case)  was  clearly  the  first-order, 
attenuated  washout.  Recommended  parameters  (for  this  type 
of  task)  would  be:  attenuation  factor  0.5-0.7>  and  washout 
time-constant  of  2-3  seconds  (break  at  0. 5-0.5  rad/sec). 

The  data  base  for  this  paper  is  being  prepared  for  permanent  fiJ.ing  and 
general  access  at  the  U.S.  Defense  Documentation  Center  (DDC);  and  may  be 
requested  through  the  third  author,  at  AMRL. 

It  would  be  interesting  and  fruitful  to  analyze  and  model  the  remnant  por- 
tion of  these  data,  using  the  closed- loop  spectral  data  available  (e.g.,  as  in 
Fig.  6).  Because  the  inputs  were  carefully  selected  and  shaped  to  be  repre- 
sentable by  filtered  white  noise,  various  optimal-control-theories  could  be 
tested  against  this  very  consistent,  accurate,  and  definitive  data  base. 
Finally,  using  these  model  and  parameters  (which  precisely  fit  almost  every 
data  point,)  various  analytical  manipulations  of  the  data  can  be  performed  to 
gain  further  insight  about  pilot  adaptation  to  motion  cues  and  washouts. 
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Introduction 


A problem  of  Interest  In  the  design  of  simulators  Is  the  development 
of  a design  criteria  such  that  the  simulators  can  be  adjusted  until  they 
emulate  real  world  situations.  In  this  paper  such  a design  criteria  is 
obtained  to  compare  two  simulators  and  evaluate  their  equivalence 
or  credibility.  In  the  subsequent  analysis  the  comparison  of  two  simulators 
can  be  considered  as  the  same  problem  as  the  comparison  of  a real  world 
situation  and  a simulation's  representation  of  this  real  world  situation. 

The  design  criteria  developed  here  involves  modeling  of  the  human 
operator  and  defining  simple  parameters  to  describe  his  behavior  in  the  sim- 
ulator and  in  the  real  world  situation.  In  the  process  of  obtaining 
human  operator  parameters  to  define  characteristics  to  evaluate  simulators, 
measures  are  also  obtained  on  these  human  operator  characteristics  which  can 
be  used  to  describe  the  human  as  an  information  processor  and  controller. 
Such  modeling  is  motivated  by  the  work  of  Fitts  [1],  Senders  [2],  Verplank 
[3],  and  others.  First  a study  is  conducted  on  the  simulator  design  problem 
in  such  a manner  that  this  modeling  approach  can  be  used  to  develop  a 
criteria  for  the  comparison  of  two  simulators. 


Symbols 

ST(t)  Stick  response  of  the  human  operator , 

^it)  The  Kalman  filter's  best  estimate  of  ST(t), 

v(t)  The  residuals,  innovations,  or  modeling  error. 

S An  approximation  to  signal  power  generated  by  the  human. 

N An  approximation  to  noise  power  generated  by  the  human. 
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Symbols 


e(t)i  E(s)  The  closed  loop  error  signal  and  its  Laplace  transform. 


The  discrete  state  transition  matrix. 

1(7  One  standard  deviation  of  a parameter  estimate. 

K The  Kalman  Gain  matrix, 

o 

A,B,H  The  system  gain  matrices. 


Xj^(t),X2(t)  State  variables  which  describe  ST(t)  and  ST(t). 

P,R,Q  UnlcTiOwn  covariance  matrices. 

^ Sample  covariance  function  (from  the  data). 

Sample,  normalized  autocorrelation  function. 

BW  An  approximation  to  bandwidth  of  the  human  operator. 


THE  SIMULATOR  DESIGN  PROBLEM 


In  the  comparison  of  two  simulators  or  In  the  comparison  of  a simulator 
with  a real  world  situation,  an  aesumptlon  Is  made  as  follows: 

Assumption  (1); 

Simulator  A ■ Simulator  B if  the  human  operator  in  Simulator  A has  the  same 
"model  characteristics"  as  the  human  operator  In  Simulator  B. 

The  key  term,  "model  characteristics"  will  be  more  explicitly  defined  via 
the  modeling  procedure.  An  alternative  problem  that  can  be  solved  via  this 
procedure  is  the  validation  of  a simulator  in  comparison  to  a real  world 
situation.  In  this  case  the  definition  of  simulator  credibility  is  best 
described  by  assumption  (2) 

Assumption  (2); 

Simulator  A ■■  the  real  world  if  the  human  operator  in  Simulator  A has  the 
same  "model  characteristics"  as  the  human  operator  in  the  real  world  situation. 
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In  practice,  the  usefulness  of  assumption  (2)  has  application  if  it  is 
possible  to  take  data  in  the  real  world  situation  as  well  as  in  the  simulator. 
If  the  simulator  can  be  adjusted  so  that  the  human  operator  parameters  in  the 
real  world  situation  are  close  to  the  human  operator  parameters  in  the  Simula- 
tor,  then  the  simulator  has  replicated  the  real  world  situation.  This  agrees 
intuitively  with  the  definition  of  a replication  of  an  experiment.  A repli- 
cation of  an  experiment  is  simply  two  empirical  runs  of  data  in  which  some 
variable  shows  consistency  in  both  of  the  two  empirical  runs.  In  this  case 
the  variables  that  are  to  show  consistency  are  the  human  operator  model 
parameters.  If  these  parameters  show  consistency  between  the  real  world 
situation  and  the  simulator,  Chen  the  simulator  has  replicated  the  real 
world  situation.  If  the  human  operator  appears  the  same  in  both  the  simulator 
and  in  the  real  world  situation,  and  he  rates  the  two  to  be  the  same  subject- 
ively, then  the  simulator  has  reproduced  the  desired  environment  from  the 
point  of  view  of  the  human. 

The  data  base  used  to  study  the  measures  of  simulator  credibility 
involves  a washout  experiment  as  discussed  in  [A].  This  experiment  provides 
a unique  opportunity  to  study  how  well  the  simulator  replicates  the  real 
world  situation. 


THE  G-VECTOR  TILT  WASHOUT  EXPERIMENT 


The  G-Vector  tilt  washout  experiment  conducted  at  the  Aerospace  Medical 
Research  Laboratory  provides  a data  base  to  Investigate  the  simulator 
credibility  question.  The  data  base  used  here  involved  a large  centrifuge 
which  has  the  capability  cf  positioning  the  roll  axis  normal  to  the  earth's 
gravity  (called  0°)  or  parallt.1  with  the  earth's  gravity  vector  in  which  the 
subject  is  on  his  back  or  supine  (called  90*^).  Six  experimental  conditions 
were  considered  in  this  study. 

0°  Conditions  (Upright  Position)  90°  Condition  (Subject  on  his  back) 

0°  Motion  90°  Motion 

0^  Washout  - Attenuation  only 
0°  Washout  - 1st.  order  washout 
0°  Washout  - 1st.  order  + attenuation 
0°  Washout  - 2nd.  order 


As  the  subject  makes  a command  stick  response,  the  simulator  rolls  to  ^ 
simulate  an  aircraft  in  a banking  maneuver.  It  is  obvious  that  in  the  0° 
(upright)  motion  case  the  human  has  both  tilt  cue  information  as  well  as 
angular  acceleration  cue  Information.  In  the  90°  (subject  on  his  back) 
motion  case,  the  human  does  not  have  the  tilt  cue  information.  The  four 
washout  conditions  were  conducted  at  0°  (upright  position)  and  a washout 
circuit  was  installed  between  the  stick  response  and  the  plant's  roll 
characteristics  (Fig.  (la-b)).  The  effect  of  the  washout  circuit  is  to 
distort  the  motion  cues  to  the  human. 

The  manner  in  which  this  data  base  is  equivalent  to  the  simulator  cred- 
ibility problem  is  that  the  "real  world"  is  defined  as  the  90^  motion  case. 


505 


The  question  Is  then  asked,  which  washout  scheme  at  0^  is  closest  to  the  real 
world  90^  motion  case?  The  0^  washout  conditions  contain  reduced  tilt  cue 
information  and  also  contain  some  distorted  motion  cues  from  the  washout 
circuits.  The  modeling  procedure  which  enables  the  determination  of  an  equiva- 
lence definition  between  two  simulators  is  presented  next. 


THE  MODELING  APPROACH 


Figure  (2)  Illustrates  how  the  modeling  approach  was  conducted  here.  After 
the  data  was  collected  from  the  various  experimental  conditions  a post 
experimental  analysis  was  conducted  with  a model  developed  in  such  a manner 
that  the  human  operator  can  be  modeled  as  an  information  processor  and  controller. 
With  reference  to  figure  (2),  the  input  to  the  model  is  the  time  series  e(t) 

(the  displayed  error  signal) . The  purpose  of  this  modeling  approach  is  to 
choose  model  parameters  such  that  the  model’s  output  5^(t)  is  an  accurate 
representation  of  the  measured  stick  response  of  the  human.  The  measure  of 
modeling  accuracy  is  expressed  in  the  residuals  or  output  modeling  error  v(t) 
which  satisfies: 


v(t)  - ST(t)  -^(t)  (1) 

If  the  model  is  appropriately  fitted  to  the  data,  then  v(t)  should  be  a 
random  white  process  which  satisfies: 

mean  ( v(t)  ] ■ E(v(t)J  ■ 0 (2) 

var  (v(t)3  ■ E(v(t)v^(T>J  - R «(t-t)  (3) 

It  will  be  necessary  in  the  subsequent  analysis  to  test  v<t)  for  whiteness 
and  determine  R of  equation  (3).  If  v(t)  is  a random  white  process,  then 
the  expected  value  of  the  model  is  equal  to  the  expected  value  of  the 
human's  output.  This  is  one  method  to  validate  such  a model.  A simple  model 
structure  is  discussed  next  to  describe  the  human's  characteristics  of  Interest. 


A SIMPLE  MODEL  TO  DESCRIBE  HUMAN  OPERATOR  CHARACTERISTICS 


It  is  desired  to  develop  a model  to  characterise  the  human  operator 
parameters  of  Interest  for  this  study.  From  previous  studies  [5,6],  other  sla»> 
pie  representations  of  the  human  which  have  application  in  specific  situations 
have  been  developed.  In  this  paper  a modeling  approach  will  be  used 
that  will  give  rise  to  simple  methods  to  characterise  human  operator  parameters 
across  several  experimental  conditions  (or  simulator  designs).  These 
modeling  characteristics  turn  out  to  be  analogous  to  an  Inforsmtion  theory 
representation  of  the  human.  Using  the  definition  of  channel  capacity: 


S4K 

channel  capacity  ■ Bandwidth  * ( ~|^  ) 


(A) 


506 


The  Bandwidth  tern  is  analogous  to  speed  and  the  term  log^QC*-^)  is  analogous 

to  accuracy.  If  the  human  operator  has  characteristics  similar  to  an  informa- 
tion channel,  one  would  expect  a product  of  the  form  of  equation  (4)  to  be 
invariant  over  several  experimental  conditions.  It  is  then  necessary  to 
determine  only  two  characteristics  of  the  human  operator  in  this  representa- 
tion of  responses.  To  determine  bandwidth,  use  is  made  of  the  human  describing 
function  plots.  In  the  determination  of  the  accuracy  measure,  a Kalman  filter 
must  be  used. 


From  figure  (3),  it  Is  desired  to  have  a method  by  which  an  approximate 
measure  of  human  operator  signal/noise  ratio  can  be  determined.  In  this 
modeling  procedure,  the  Kalman  filter  is  initially  specified  to  have  input- 
output  characteristics  similar  to  those  obtained  from  the  describing  function 
with  the  addition  of  some  pliase  lag  to  account  for  the  time  delay  of  the 
human.  The  unknown  Kalman  gain  coefficients  (which  represent  the  uncertainty 
terms  or  covariance  matrices)  are  updated  [7]  in  such  a manner  that  the 
residuals  v(t)  are  white.  The  signal  to  noise  ratio  can  then  be  approximated 
by: 


N 

S4-N  -v.  i»l 
N ‘ N ' 

I (v(tJJ^ 
i»l 


(5) 


It  is  noted  r.t'.ar  the  variance  of  the  residuals  v(t)  are  a measure  of  human 
uncertainty  with  respect  to  the  error  signal.  This  is  true  because  the 
Kalman  filter  output  l^(t)  is  that  portion  of  the  stick  response  correlated 
with  the  error  signal.  The  residuals  v(t)  are  that  portion  of  the  stick 
output  not  correlated  with  the  error  signal.  This  definition  of  human  uncer- 
tainty differs  from  the  classical  definition  of  remnant  [8,9]  which  is  defined 
as  that  portion  of  human  response  not  correlated  with  the  input  forcing 
function.  This  definition  of  human  uncertainty  is  concerned  with  that  part  of 
the  human  response  which  is  totally  non-productive  in  reducing  the  error 
signal.  This  is  easily  seen  to  be  true  by  noting  that  v(t)  when  passed 
through  the  plant  and  around  the  loop  still  is  uncorrelated  with  the  error 
signal.  Hence  it  cannot  constructively  be  used  to  reduce  the  error  signal 
because  of  its  orthogonality  to  it.  This  measure  of  human  uncertainty  is  a 
true  measure  of  human  output  not  useful  In  the  tracking  task.  Next,  a descrip- 
tion of  the  measures  of  bandwidth  and  accuracy  obtained  from  this  modeling 
procedure  are  presented. 


CALCULATION  OF  BANDWIOTH 


In  the  computation  of  a measure  of  the  bandwidth  of  the  human  operator, 
several  dlfflculities  exist  in  attempting  to  treat  the  human  as  an  information 
channel  [10].  This  is  due  to  dlfflculities  in  determining  the  true  describing 
function  from  measured  data  variables  and  the  effects  of  correlation  between 
the  human's  remnant  response  and  portions  of  the  measured  error  signal.  In 
this  paper  several  approximations  will  be  made.  Figure  (A)  illustrates  1 te 


507 


describing  function  of  the  human  for  the  0^  motion  case.  Across  the  six 
experimental  conditions  considered  here,  the  shape  of  the  human  operator 
describing  function  remained  essentially  the  same;  the  major  change  between 
experimental  conditions  was  only  due  to  the  d.c.  gain  values  where  the 
describing  function  was  at  a maximum.  The  ensuing  analysis  was  conducted  on 
the  spectrum  generated  by  the  target  frequencies.  The  reason  it  is  necessary 
to  work  with  the  target  frequencies  is  that  if  the  target  forcing  function 
were  zero,  the  describing  function  of  the  human  operator  obtained  from  only 
the  human  operator  response  (or  for  small  values  of  disturbance  input)  is 
just  equal  to  *-l/plant.  This  result  is  well  known  [10,11]. 

From  the  target  spectrums  all  experimental  conditions  are  rated  in  order 
of  their  maximum  gain  value  (table  I).  From  table  T.  it  is  seen  that  0**  static 
has  the  lowest  gain  value.  The  largest  frequency  the  human  will  pass  for  this 
value  of  gain  is  now  determined  for  each  experimental  condition. 

This  definition  of  the  human  operator  bandwidth  is  the  highest 
frequency  at  which  the  human  will  respond  with  gain  of  0.5  db.  In  other  words 
across  all  experimental  conditions,  the  range  of  frequencies  (from  0.0  radians 
and  upward)  is  obtained  that  the  human  will  pass  with  gain  greater  than  O.Sdb. 

In  this  manner  a normalization  is  conducted  on  one  experimental  condition  ver- 
sus the  remaining  experimental  conditions.  This  is  a logical  definition  of 
human  bandwidth  and  is  one  of  many  possible  methods  to  approximate  the  bandwidth 
of  a control  system  [12].  Measures  of  human  uncertainty  in  tracking  are, det- 
ermined next* 


Table  I - Bandwidth  Computation  - Subject  - Eric 


Experimental 

Condition 

Maximum  Gain 
in  db 

Bandwidth  A lUgest  Frequency 
where  gain  0.5  db 

10 

0*  ^k>tlon 

6.5db 

10.8  Rad/Sec 

m 

Washout 

Attenuation  only 

4.8db 

9.8  Rad/Sec 

m 

90*  Motion 

A.Sdb 

9.5  Rad/Sec 

D 

Washout  1st  Order 
-t*  Attenuation 

3.5db 

9.2  Rad/Sec 

1.1 

Washout 
1st  Order 

2.9db 

8.3  Rad/Sec 

0.8 

Washout 
2nd  Order 

3.3db 

8.2  Rad/Sec 

1.1 

0*  Static 

O.Sdb 

7.3  Rad/Sec 

1.0 
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MEASUREMENT  OF  ACCURACY  OR  SUBJECT  UNCERTAINTY 


With  reference  to  figure  (5)  it  is  desired  to  update  the  model  parameters  In 
such  a way  that  the  innovations  sequence  v(t)  is  a white,  random  process. 

The  method  of  updating  the  parameters  is  based  on  an  algorithm  [7]  which  is 
actually  a maximum  llklihood  procedure.  In  this  manner  a unique  value  of  the 
optimal  gain  can  be  determined  which  maxim iz.es  the  probability  density  function 
of  the  structure  of  the  assumed  model  based  on  all  the  available  data  points. 
The  optimal  gain  is  the  principal  part  of  the  discrete  Kalman  filter  model 
which  is  described  by: 


1+1/1  " ^ *1/1'*’/  e^^dTBcol[e(t),e(t)J 

0 


"i/i 


1/1-1 


+ - H ] 


(7) 


where Is  the  minimum  variance  estimate  of  the  human's  stick  response.  The 

matrix  Is  the  discrete  translcion  matrix  associated  with  the  human's  transfer 
function  determined  as  folxows: 


Let  ST [si  _ d(s+a) 

E[s]  * (s+b)  <s+c) 


<8) 


i.e.  a fit  of  one  zero  and  vo  poles  is  conducted  on  the  human's  transfer  func- 
tion to  the  describing  function  data  (Bode  plot).  The  coefficients  a,b,c,  and  d 
are  adjusted  to  try  to  match  the  phase  data  as  well  as  the  magnitude  data.  Im- 
plicitly the  human's  time  delay  has  been  Included  in  the  representation  (8) 
through  the  adjustment  of  the  parameters  b and  c.  Future  work  will  be  done 
to  study  more  exact  fits.  The  matrix  6 is  then  determined  via  . kt^t 

where  ^t^.OA  seconds  (the  sampling  rate)  and  the  matrix  A is  determined  via: 


where 


+ B 


e(t) 

e(t) 


x^(t)  - ST(t) 

X2(t)  - ~ ST(t) 


(9) 


and  equation  (9)  Is  the  time  domain  representation  of  equation  (6).  The 
matrix  H In  equation  (7)  is  specified  by  H - [1,0].  The  Kalman  gain  K 
satisfies:  ° 


K * P (HPH^  + R)”^ 

0 

P - [P-PH^(HPh’^  + R)"^  HP](j>’^  + Q 
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where  the  covariance  matrices  Q and  R describe  the  human's  uncertainty  in 
the  tracking  task.  The  manner  of  obtaining  the  Q and  R matrices  is  based  on 
the  algorithm  in  [7],  Initial  matrix  values  denoted  as  and  are  chosen.  In 

order  to  establish  the  updating  rule,  it  is  necessary  to  define  the  sample  cov- 
ariance function. 


Let: 


1 

N 


N 

£ 

i=k 


is  a sample  covariance  function.  The  matrices  R and  Q are  now  updated  [7]  via: 


where  P, 

k 

* 

where  A 

and  T 


and  finally  Q is  determined  via: 


t - H(P,  H^) 
o k 


= P - 4>KR^^K'*^(j>^  - 4)(I-KH)P(I-KH)%'^ 

This  algorithm  has  been  shown  to  converge  [7]  and  is  equivalent  to  maximizing 
the  log-likelihood  function  of  the  model  structure  conditioned  on  the  data. 

The  final  validation  of  this  modeling  effort  is  the  need  to  test  the 
residuals  for  whiteness.  To  accomplish  this  goal  the  normalized  auto  correla- 
tion function  is  computed  as  follows: 


The  test  of  whiteness  of  the  residuals  is  a 95%  whiteness  test  on  The 

95%  confidence  limits  for  are  1.96/ \Tn  where  N is  the  number  of  samples. 

The  band  + 1.96/Mn  is  constructed  about  zero.  If  less  than  5%  of  the  sample 
points  lie  outside  the  band,  the  sequence  is  white.  If  more  than  5%  of  the 
sample  points  lie  outside  the  band,  then  a significant  correlation  exists  in 
the  residuals  and  the  sequence  is  not  white.  Figure  (6)  Illustrates  the 
sample  auto-correlation  function  obtained  here  from  the  data  after  the 
residuals  have  been  whitened  via  this  algorithm. 


RESULTS  FROM  THIS  ANALYSIS 


Figure  (7)  represents  the  type  of  diagram  obtainable  from  this  type  of 
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analysis  procedure.  The  vertical  axis  Is  a plot  of  the  measure  of  bandwidth 
as  shown  in  Table  I.  The  horizontal  axis  indicates  numerical  values  of 
the  accuracy  measure  or  S/N  ratio  obtained  here.  Also  plotted  is  the  curve 
of  constant  capacity  based  on  this  analysis  procedure.  The  numerical  values 
resulting  from  this  investigation  of  the  data  are  given  in  Table  II: 

Table  II  - Speed  - Accuracy  Results 


Exp 

Condition 

Mean 

BW 

lo 
of  BW 

N=Mean 

log^QS/N 

lo 

logioS/N 

- ■■  ■ • ■ 

Mean  Capacity 
BW*logj^Q(l+S/N) 

0°  motion 

10,8 

2.0 

3.265 

,191 

34.346 

Washout 

Attenuation  only 

9.8 

0.3 

3.278 

,088 

31.719 

90“  motion 

9.5 

0.7 

3.358 

.089 

31.5025 

Washout  1st  order 
+ Attenuation 

9.2 

1.1 

3.378 

,064 

30.79 

Washout 
1st  Order 

8.3 

0.8 

3.373 

.043 

27.813 

Washout 
2nd  Order 

8.2 

1.1 

3.412 

.082 

27.634 

Also  plotted  in  figure  (7)  is  the  invariant  rule: 

BW  * logj^Q(l+S/N)  » Constant  = 30.6  (11) 

The  constant  30.6  is  the  mean  of  the  values  of  capacities  obtained  in  the 
right  most  column  in  Table  II.  From  figure  (7)  it  is  noted  that  most  of  the 
experimental  conditions  fall  near  this  line. 

Figure  (7)t  by  Itself,  is  the  diagram  which  can  be  used  to  assess. the 
fidelity  of  a simulator  in  comparison  to  the  real  world  data.  If  90°  motion 
is  considered  the  real  world  situation,  the  washout  scheme  closest  (distance 
wise)  to  this  situation  is  1st.  order  + attenuation.  The  other  washout 
schemes  are  sucessively  further  away  in  this  diagram  and  therefore,  further 
from  reality.  The  reason  why  it  is  said  that  the  two  experimental  conditions  best 
replicate  each  other  is  that  the  human  exhibits  almost  the  same  bandwidth 
(or  speed  characteristics  in  tracking)  and  almost  the  same  uncertainty 
characteristics  (as  measured  by  the  S/N  ratio) . 

Another  interpretation  of  figure  (7)  is  to  consider  the  Inverse  problem 
associated  with  modeling;  l.e.  given  the  model  parameters,  can  an 
analog  simulation  be  built  which  will  recreate  the  original  empirical  data. 

If  the  human  in  the  loop  were  replaced  by  a quantitative  description  (e.g. 
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bandwidth  and  S/N  ratio),  the  analog  simulations  of  the  90^  motion  case  and 
washout  1st  order  + attenuation  would  most  closely  replicate  one  another.  This 
is  true  because  the  only  difference  between  the  two  simulations  would  be  the 
parameters  which  describe  the  human  operator.  If  these  parameters  are  close 
to  one  another  in  some  sense,  then  these  simulations  would  best  match.  This 
is  the  motivation  for  using  figure  (7)  to  study  simulator  fidelity. 

One  additional  comment  needs  to  be  made  about  why  the  washout  scheme  of 
1st.  order  + attenuation  best  matched  the  90°  motion  case.  The  0°  washout 
condition  provided  tilt  cue  information  but  the  1st.  order  + attenuation 
washout  filter  phase  lag  had  the  effect  of  distorting  these  tilt  cues 
sufficiently  to  replicate  the  90°  motion  case.  For  the  case  of  attenuation 
only,  the  tilt  cue  had  an  effect  closer  to  0°  motion  (as  expected).  Also,  as 
the  washout  scheme  added  more  phase  lag  (2nd  order  case) , the  deviation  from 
reality  became  more  pronounced  and  the  human  operator  dropped  his  bandwidth 
accordingly. 


Future  Research 


The  primary  approximation  used  here  was  in  the  evaluation  of  human  operator 
bandwidth.  This  approximation  also  effected  the  S/N  ratio  because  the  A matrix 
in  the  Kalman  filter  depends  on  this  approximation.  Future  research  will 
consider  more  accurate  methods  of  evaluating  bandwidth  and  including  human 
time  delay.  In  addition,  a comparison  will  be  made  in  the  information  rate 
obtained  here  to  results  from  discrete  tasks  ( approximately  3.0  blts/sec  [13]) 
and  to  other  information  measures  obtained  from  vision  [14],  reading  [15], 
and  control  systems  in  general  [16] . Another  approximation  utilized  here  was 
that  the  S/N  ratio  of  the  human  was  assumed  to  be  constant  over  the  entire 
frequency  spectrum.  In  [3]  the  analysis  procedure  was  able  to  study  the 
capacity  measure  across  the  entire  frequency  spectrum.  The  procedure  consid- 
ered here  can  be  extended  in  this  respect.  Also,  since  the  analysis  conducted 
here  only  involved  one  subject,  future  work  will  consider  this  analysis  across 
different  subjects,  and  use  will  be  made  of  these  measures  of  human  invariance 
and  subjective  uncertainty  in  various  task  situations. 


SUMMARY  AMD  CONCLUSIONS 


A study  of  design  rules  for  the  evaluation  of  a simulator's  fidelity  to 
the  real  world  situation  was  conducted.  The  measures  of  model  parameters 
obtained  here  give  rise  to  information-theoretic  models  of  the  human  operator. 
It  appears  that  an  invariant  rule  may  exist  on  the  human's  ability  to  do 
information  processing  over  a variety  of  different  experimental  conditions. 
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SIMOLATQR  WASHOUT  SCHEMES 
By  Susan  A.  Riedel  and  L.  0.  Hofnann 
Syetems  Technology,  Inc. 
Havthome,  California 

INTROSUCnON 


Research  interest  In  washout  filters  for  motion  simulator  drives  arises 
out  of  a desire  to  maximize  the  fidelity  of  motion  cues  presented  to  simu- 
lator pilots.  Washout  filters  must  satisfy  two  important,  usually  conflict- 
ing, requirements: 

1.  The  filter  (along  with  the  limiters)  must  prevent 
the  simulator  from  reaching  the  mechanical  limits 
in^josed  on  displacement,  velocity  and  acceleration 
in  each  axis. 

2.  The  filter  must  reproduce  actual  motion  cues  with- 
out perceptible  distortion.  That  is,  motions  con- 
tributed because  of  the  washout  must  be  impercep- 
tible to  the  pilot. 

The  first  requiren^nt  basically  dictates  Integrated  consideration  of 
known  motion  base  limits,  existing  limiter  circuitry  and  the  proposed  wash- 
out design.  The  result  should  be  a design  which  is  not  at  crossed  purposes 
with  the  limiters.  The  second  requirement,  however,  demands  knowledge  of  the 
physiology  of  motion  perception.  Research  in  engineering,  physiology  and 
psychology  has  lead  to  models  of  certain  rechanisfos  for  motion  perception, 
and  has  greatly  sharpened  our  knowledge  of  human  motion  perception  capability. 
These  capabilities  (or  lack  thereof)  can  then  be  exploited  by  the  washout 
designer  in  fulfilling  the  second  requirement. 

The  first  section  of  this  paper  presents  an  overview  of  some  of  the 
promising  washout  schemes  which  have  recently  been  devised.  The  four  schemes 
presented  fall  into  two  basic  configurations;  crossfeed  and  crossproduct. 
Various  nonlinear  modifications  further  differentiate  the  four  schemes. 


The  second  section  of  this  paper  discusses  one  nonlinear  scheme  in 
detail.  This  washout  sehen«  takes  advantage  of  subliminal  motions  to  speed 
up  simulator  cab  centering.  It  exploits  so-called  perceptual  indifference 
thresholds  to  center  the  simulator  cab  at  a faster  rate  whenever  the  input 
to  the  simulator  is  below  the  perceptual  indifference  level.  Tiie  effect  is 
to  reduce  the  angular  and  translational  simulator  motion  by  con^jarison  with 
that  for  the  linear  washout  case. 
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The  final  section  of  this  paper  presents  the  conclusions  and  implications 
for  further  research  in  the  area  of  nonlinear  washout  filters. 


An  Overview  of  Nonlinear  Washout  Technlquea 

All  nonlinear  washout  schemes  presented  here  are  modifications  to  one 
of  the  two  basic  linear  desiKns  shown  in  figure  1 . For  simplicity,  a single 
set  of  coupled  axes  for  each  design  is  depicted.  The  crossproduct  scheme, 
attributed  to  Schmidt  and  Conrad  (reference  5)»  is  currently  in^jlemented  on 
the  Large  Amplitude  Multimode  Aerospace  Research  Simulator  (LAMARS)  (refer- 
ence ?)•  The  crossfeed  scheme  (reference  6)  attributed  to  Bray  is  iniplentented 
on  the  Flight  Simulator  for  Advanced  Aircraft  (FSAA)  (reference  8). 

An  interesting  aspect  of  the  crossproduct  scheme  is  that  the  recovered 
specific  force  always  equals  the  input  specific  force  in  the  absence  of  any 
additional  filtering  of  translational  acceleration.  In  the  figure,  this 
implies  VpQ  = ^poF*  This  result  is  due  to  the  configuration  of  the  residual 
tilt  and  coordinating  crossfeed  paths.  Notice  that  because  of  the  different 
arrangements  for  the  coordinating  crossfeed  and  residual  tilt  paths  in  the 
crossfeed  schertK,  ^po  and  (^pqp  are  not  necessarily  equal. 

Table  1 compares  four  nonlinear  washout  schemes  which  are  in  various 
stages  of  development.  Because  of  the  nonlinear  nature  of  these  schemes  it 
is  not  possible  to  predict  the  outcome  of  a given  experiment  based  on  the 
results  of  previous  experiments.  Thus,  conclusions  drawn  from  test  results 
for  these  nonlinear  schemes  are,  at  best,  tentative. 

Figure  2 presents  a roll  axis  example  of  the  adaptive  gain  (Parrish, 
references  2 and  5)  scheme.  The  gain  Kp  is  computed  on-line  based  upon  a 
cost  function.  This  cost  function  is  a functio.n  of  roll  rate,  roll  angle 
and  initial  Kp.  It  Includes  several  constants  which  can  be  varied  to  "tune” 
the  filter.  The  cost  function  is  integrated  and  limits  are  imposed  to  obtain 
the  filter  gain.  This  gain  varies  with  time.  When  the  filter  is  tuned  for 
a particular  application,  Parrish  and  Martin  found  it  helpful  for  reducing 
the  so-called  "false  cue"  observed  in  pulse-type  maneuvers. 

Figure  5 Illustrates  a sway-axis  example  of  the  varying  break  frequency 
(Jewell,  reference  l)  scheme.  In  this  case  a cost  function  is  used  to  compute 
the  time-varying  break  frequency  of  the  second-order  translational  washout. 

The  cost  function  is  a function  of  the  translational  acceleration,  velocity 
and  position  as  well  as  break  frequency  itself.  Constants  are  available  to 
tune  the  filter.  The  cost  function  is  then  Integrated  and  a limit  is  Imposed 
to  obtain  the  break  frequency.  Jewell  has  demonstrated  in  a computer  siiuu- 
lation  that  a two-fold  reduction  in  translational  motion  can  be  achieved  for 
a quosl-random  input. 

Figure  ^ presents  a portion  of  the  surge  axis  as  it  appears  In  a sig.ial 
compression  scheme  which  Incorporates  parabolic  limiting.  While  both  the 
Parrish  and  the  Jewell  schemes  addressed  the  problem  of  increased  simulation 
fidelity  and  decreased  motion  base  requirements,  this  scherae  proposes  a solu- 
tion for  the  problem  of  the  hardware  motion  base  limits.  The  essence  of  this 
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Crossproduct  Scheme  - Schmidt  and  Conrad  - LAMARS 


Figure  1 . Basic  Single -Axis  Linear  Washout 
Circuit  Framework 
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TABLE  1 . COMPARISON  OF  POUR  NONLINEAR  WASHOUT  SCHEMES 


Adaptive 

Gain 

Variable 

Break 

Frequency 

Parabolic 

Limiting 

Subliminal 

Description 

Varies  wash- 
out gain  K 
using  a cost 
function 

Varies  wash- 
out break 
frequency 
o:\p  using  a 
Parrish-type 
cost  func- 
tion 

Incorporated 
in  electrical 
drive  to  com- 
mand maximvun 
deceleration 
to  stop  simu- 
lator at 
limits 

Increases 
washout  rate 
when  input 
is  subthresh- 
old to  force 
cab  back  to 
zero  position 
faster 

Purpose 

Eliminate 
"false  cue" 

Reduce 
motion  base 
displacement 
requirements 

Back-up  sys- 
tem for  hard- 
ware and 
software 
units 

Reduce  motion 
base  displace- 
ment require- 
ments 

Principal 

Investigators 

NASA-Langley 

Parrish 

Martin 

STI 

Jewell 

Jex 

NASA -Ames 

Bray 

Sinacori 

STI 

Hofmann 

Riedel 

Level  of 
Investigation 

Implemented 
on  Langley 
Visual 
Motion  Simu- 
lator 

Computer 
model  roll- 
sway  axes 

Inplemented 
on  FSAA 

Conputer 
model  roll- 
sway  axes 

Underlying 
Linear  Basis 

Crossproduct 

Crossproduct 

Crossfeed 

Crossproduct 

Inputs  for 
Which  Scheme 
Is  Most 
Effective 

Pulse -type 
inputs 

All  Inputs 

Large  inputs 
which  could 
cause  limit- 
ing 

Small,  sub- 

threshold 

inputs 

Level  of 
Success 

May  elimi- 
nate "false 
cxies" 

Twofold 
reduction  in 
lateral  dis- 
placement 
requirement 

Avoids  hit- 
ting hardware 
limits 

Twofold 
reduction  in 
lateral  dis- 
placement 
requirement 

Side  Effects 

Increased 

nonlinearity 

with 

increased 

motion 

Increase  in 
lateral 
specific 
force  mlsco- 
ordination 

Increase  in 
lateral 

specific  force 

miscoordina- 

tion 

References 

2,  3 

1 

6 
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Figure  2.  Adaptive  Gain  Scheme 
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Parabolic  Limiter 


Figure  4,  Parabolic  Limiting  Scheme  Incorporating 
Signal  Compression 
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scheme  is  a continuous  calculation  to  assure  that  the  cah  can  be  brought  to 
zero  velocity  before  displacement  limits  are  reached.  The  commanded  motion 
is  reproduced  to  the  extent  that  a margin  between  the  calculated  stopping 
point  and  the  displacement  limits  exists.  In  this  way,  maximum  use  may  be 
made  of  the  available  motion  capability. 

The  fourth  washout,  the  subliminal  scheme,  is  the  subject  of  the  next 
section  of  this  paper. 


THE  SUBLIKDIAL  WASHOUT  SCHEME 


Figure  5 presents  an  application  of  the  subliminal  washout  scheme  to  a 
first-order  roll  axis  washout.  This  concept  came  about  as  the  result  of  an 
atteti3)t  to  utilize  so-called  "indifference"  thresholds  which  pilots  exhibit 
under  normal  workload.  These  thresholds  may  be  operative  for  both  angular 
velocity  and  specific  force  perception  under  normal  workload.  The  hypoth- 
esis is  that  pilots  do  not  perceive  angular  velocities  and  specific  forces 
which  are  below  the  respective  indifference  thresholds.  The  washout  design 
objective  is  to  exploit  this  particular  phenomenon  to  obtain  reduced  simulator 
motion  requirements  or  increased  motion  fidelity. 

The  overall  design  goal  is  to  drive  the  cab  back  to  its  zero  position 
more  rapidly  than  would  the  underlying  linear  washout  whenever  the  motion 
stimulus  is  below  the  indifference  threshold  level.  This  is  accomplished 
with  the  use  of  the  two  nonlinear  functions  in  boxes  A and  B in  figure  5. 

The  input  to  the  function  in  Block  A is  the  scaled  angular  velocity.  This 
function  produces  a weighting  factor  which  serves  as  a variable  feedback 
gain  in  the  washout  circuit.  If  the  input  magnitude  is  larger  than  the 
indifference  threshold  ptp,  the  weighting  factor  is  zero.  If  the  input  is 
zero,  the  weighting  factor  is  1 .0,  Otherwise,  the  weighting  factor  is  some 
fraction  of  1 .0  which  is  a sinusoid-like  function  of  the  input  for  the  form 
of  the  weighting  function  used  here. 

The  input  to  Block  B,  a soft  saturation  nonlinear  function,  is  cab  roll 
angle,  cp.  If  cp  is  large,  the  value  of, the  function  output  is  the  value  of 
the  indifference  threshold  level,  ±p^.  If  cp  is  small  the  value  of  the  func- 
tion output  is  proportional  to  cp. 

The  outputs  from  Blocks  A and  B are  then  multiplied  to  arrive  at  an 
incremental  washout  rate  command  signal.  The  particular  choice  of  functions 
in  Blocks  A and  B assures  that  this  signal's  magnitude  never  exceeds  the 
indifference  threshold  level.  The  smoothness  of  the  functions  in  Blocks  A 
and  B tends  to  prevent  discontinuous  commanded  changes  in  the  washout  rate. 

The  value  of  this  incremental  washout  rate  command  signal  will  be  non-zero 
whenever  the  cab  roll  angle  is  non-zero  and  the  input  angular  velocity  is 
below  the  indifference  threshold  level.  The  signal  is  then  subtracted  from 
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Nonlineor  | Uneor 


Ps  +_  ^ m ^ 


p s Input  Angulor  Velocity 
P3  : Scoled  Angular  Velocity 

Pf  = Indifference  Threshold  Level 
^ - Commanded  Cob  Roll  Rate 
tp  = Commanded  Cab  Roll  Angle 

Figure  5*  Nonlinear  Washout  Scheme  (First-order  Washout) 

the  scaled  input  angular  velocity.  The  result  is  a smaller  away-from-center 
angular  velocity  input  to  the  integrator  than  would  result  for  the  underlying 
linear  scheme.  Thus,  the  cab  is  driven  back  to  its  zero  position  more  quickly 
than  it  would  be  for  the  linear  scheme,'  during  intervals  of  sub-threshold 
inputs  in  angular  velocity. 

Preliminary  tests  of  this  subliminal  washout  concept  for  the  roll  axis 
showed  it  to  be  ineffective.  There  was  some  reduction  in  simulator  motion 
requireiTients,  but  not  really  enough  to  warrant  further  investigation. 

Figure  6 shows  an  application  of  this  same  washout  concept  to  the  lateral 
specific  force  channel  of  a crossproduct  washout  configuration  for  roll -sway 
axes. 

It  was  pointed  out  in  the  discussion  of  the  crossproduct ^scheme  that  the 
input  specific  force,  Vpo,  and  the  recovered  specific  force,  'Vpop,  are  always 
equal  for  the  crossproduct  washout  configuration.  In  this  case  the  subliminal 
washout  introduces  intentional  raiscoordination  of  specific  force.  The  indif- 
ference phenomenon  allows  this  deliberate  introduction  of  specific  force  mis- 
coordination,  and  as  long  as  this  miscoordination  does  not  exceed  the  specific 
force  indifference  threshold  level,  the  pilot  under  normal  workload  will  not 
detect  the  miscoordination. 
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Figure  6.  IiAMABS  Drive  Logic  Washout  with  Nonlinear  Feedback 
Added  to  Specific  Force  Path  Only 
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Computer  simulation  results  for  the  •washout  in  figure  6 are  presented 
in  figure  ?•  The  input  to  the  simulation  corresponds  'to  a roll-in  to  a 
constant  4 g turn.  The  inputs  are  roll  rate,  Pa#  and  lateral  specific  force, 
Vpo.  There  is  no  reduction  in  acceleration,  y,  slight  reduction  in  velocity, 
y,  and  significant  reduction  in  lateral  translation,  y.  These  results  show 
clearly  that  the  subliminal  •washout  substantially  reduces  simulator  displace- 
ment motion  requirements.  Lateral  translation  reduction  is  70  percent,  i.e., 
from  a maximum  linear  displacement  of  4.05  m (15*5  f't)  to  a maximum  displace- 
ment of  1.2  m (4  ft). 

In  order  to  accon5>lish  this  substantial  reduction  in  lateral  translational 
requirements,  however,  a substantial  change  in  recovered  specific  force  is 
generated  because  of  miscoordination.  This  is  due  to  the  increased  washout, 
rate  for  the  subliminal  washout  scheme.  Since  the  increase  in  washout  rate  is 
constrained  to  at  or  below  an  indifference  threshold  level  of  0.1  g,  the  change 
in  recovered  specific  force  is  also  constrained  to  that  level.  Thus,  under 
normal  workload  the  pilot  should  not  be  able  to  detect  this  level  of  miscoordi- 
nation. 

The  computer  simulation  of  the  subliminal  washout  has  been  exercised  for 
a variety  of  inputs.  Significant  reductions  in  motion  base  requirements  have 
been  observed.  On  the  basis  of  these  results  the  following  conclusions  can 
be  drawn: 

1.  The  subliminal  -washout  concepts,  as  iit5)lemented  in  the 
translational  axes  of  the  crossproduct  scheme,  are  effec- 
tive in  reducing  the  velocity  and  displacement  require- 
ments of  the  motion  base. 

2.  The  subliminal  washout  scheme  is  most  effective  for  sub- 
indifference  threshold  specific  force  inputs . The  wash- 
out reduces  to  the  underlying  linear  scheme  when  inputs 
exceed  this  threshold. 

5.  The  use  of  the  subliminal  threshold  scheme  results  in 

an  increase  in  recovered  specific  force  which  is  spurious. 

This  spurious  motion  is  due  to  additional  miscoordination. 

The  nonlinear  implementation  insures  that  this  miscoordi- 
nation cori5)onent  is  never  greater  than  the  assumed  indif- 
ference threshold  level.  Thus  under  normal  workload, 
the  pilot  should  be  unable  to  detect  this  false  cue. 

Much  work  remains  to  be  performed  in  the  investigation  of  this  sublimi- 
nal -washout  scheme.  The  initial  results  of  the  con5>uter  simulation  have 
shed  light  on  the  scheme's  major  uses,  and  encourage  further  research  and 
eventual  simulator  implementation. 
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Time  (sec)  1 ft  = 0.3048  m 


Figure  7.  Comparison  of  Linear  and 
Nonlinear  Outputs 
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CONCLUSIONS 


A sample  of  some  new  concepts  in  nonlinear  washout  filters  has  been 
presented  here.  Since  each  scheme  addresses  a different  aspect  of  the 
washout  problem,  it  may  be  desirable  to  combine  several  nonlinear  concepts 
in  a single,  grand  scheme.  In  this  way,  several  problems  in  a particular 
simulation  could  be  handled  by  a single  washout  circuit.  Further  research 
along  these  lines  might  lead  to  a well-defined  method  for  designing  a washout 
circuit  to  suit  particular  simulation  needs,  taking  into  account  the  peculiar- 
ities of  the  motion  base  as  well  as  a description  of  the  flying  task  to  be 
simulated. 

The  research  reported  herein  was  sponsored  by  the  Air  Force  Flight 
Dynamics  Laboratory  under  Contract  F556l5“77-C-2065.  (W.  Klotzback,  AFFDL/ 

PGD  and  J,  Bankovs kis,  APFDL/FGD) 
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SUMMARY 


The  outside  scene  is  often  an  important  source  of  information  for  manual 
control  tasks.  Important  examples  of  these  are  car  driving  and  aircraft 
control.  This  paper  deals  with  modelling  this  visual  scene  perception 
process  on  the  basis  of  linear  perspective  geometry  and  the  relative  motion 
cues. 


Model  predictions  utilizing  psychophysical  threshold  data  from  base-line 
experiments  and  literature  of  a variety  of  visual  approach  tasks  are 
compared  with  experimental  data.  Both  the  performance  and  workload  results 
illustrate  that  the  model  provides  a meaningful  description  of  the  outside 
world  perception  process,  with  a useful  predictive  capability. 


INTRODUCTION 


Many  manual  control  tasks  depend  on  the  visual  perception  of  the 
outside  scene.  In  the  context  of  aircraft  control,  the  most  important 
example  is  the  visual  approach  scene.  So,  in  order  to  investigate  a great 
many  flight  situations  in  the  approach  and  landing,  it  is  mandatory  to  take 
into  account  this  visual  scene  perception  process  which  has  often  a major 
impact  on  mission  performance. 


Based  on  a concise  inventory  of  the  most  important  characteristics 
(cues)  of  the  visual  scene  the  visual  scene  perception  process  is  described 
(modelled)  on  the  basis  of  the  linear  perspective  geometry  and  the  relative 
motion  cues.  This  involves  mathematical  relationships  between  these  visual 
cues  and  the  aircraft  state  variables.  After  linearization  this  model  can  be 
integrated  in  the  exisiing  framework  describing  piloted  aircraft  behavior 
(the  optimal  control  model).  This  is  the  subject  of  the  next  chapter. 

The  visual  scene  perception  model  involves  assumptions  concerning 
perceptual  thresholds  of  the  various  cues,  noise  levels  associated  with 
observing  these  cues  and  interference  among  them.  Values  for  these  parameters 
are  derived  from  baseline  experimental  data  supplemented  by  the  psycho- 
physical literature.  Bused  on  these  values  a theoretical  analysis  is 
performed  dealing  with  a variety  of  visual  approach  conditions. 
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Furthermore y the  results  of  an  experimental  program  ore  cooqpared  with  the 
model  predictions.  In  addition,  model  predictions  of  pilot  workload  are  compared 
with  subjective  ratings. 


VISUAL  SCENE  PERCEPTION  MODEL 


One  of  the  earliest  studies  of  visual  scene  perception  directly  related 
to  flight  control  problems  has  been  performed  by  Gibson  (Refs.  ^ and  2). 
According  to  Gibson,  the  most  important  visual  cues  which  can  be  derived 
from  the  visued  field  are  related  to 

. the  linear  perspective  geometry 
. relative  motion  or  motion  parallax 
. the  apparent  size  of  objects  whose  real  size  is  known 
. a far  object  covered  by  a near  one 
. the  distribution  of  flight  and  shade  over  an  object 
. aerial  perspective  and  the  loss  of  detail  with  distance. 

Of  these,  the  linear  perspective  geometry  provides  a variety  of  cues. 
This  is  illustrated  by  the  schematic  version  of  the  visual  scene  in  figure  la 
which  can  be  thought  of  to  consist  of  lines  and  points  (textural  elements). 
This  involves  not  only  the  linear  and  angular  position  of  the  observer  with 
respect  to  the  outside  world  but  also  (dynamically)  the  relative  motion. 

The  point  of  the  visual  field  toward  which  the  observer  is  moving  appears  to 
be  stationary  ("focus  of  expansion").  All  other  textxiral  points  move  with 
respect  to  the  observer  which  can  be  indicated  by  velocity  vectors 
("streamers").  This  is  shown  in  figure  1b  for  the  case  of  rectilinear  motion. 
Various  other  references  mention  visual  cues  which  can  be  conceived  as 
examples  of  the  afore-mentioned  basic  elements.  Most  of  them  are  related  to 
the  landing  approach  scene  (Refs.  3-5). 

From  the  foregoing  it  can  be  derived  that  a reasonable  approach  is  to 
model  the  visual  scene  perception  process  on  the  basis  of  the  linear 
perspective  geometry  and  the  relative  motion  cues.  Following  reference  6 
this  involves  a description  of  the  cues  which  can  be  derived  from  the  visual 
scene  and  their  functional  relationships  with  linear  and  angular  positions 
and  velocities  of  the  observer.  When,  in  addition,  the  relationships  between 
the  moving  observer  and  the  visual  scene  can  be  linearized  about  a nominal 
condition,  the  perception  process  can  be  described  in  standard  estimation 
theoretical  terms  and  included  in  the  optimal  control  model  structure  in  the 
following  manner. 

Let  the  observer  (aircraft^)  moving  with  respect  to  the  outside  world 
be  described  by  the  system  state  x(t).  This  involves  the  common  linear  and 

in 

Although  the  following  applies  to  a variety  of  man-machine  situations, 
this  analysis  is  directed  at  the  aircraft  control  problem. 
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angular  positions  of  the  aircraft  as  well  as  additional  parameters  to  describe 
relevant  characteristics  of  the  moving  visual  scene  (with  respect  to  the 
aircraft).  After  linearization  about  a nominal  path  the  result  will  be  a set 
of  linear,  (in  general)  time-varying  equations  given  by 

x(t)  * A(t)  x(t)  + ^(t)  w(t)  (1) 

where  A(t)  describes  the  process  of  the  aircraft  moving  with  respect  to  the 
outside  world,  and  w(t)  represents  system  disturbances  (e.g.  tiirbulence) . 
Furthermore,  the  visxial  cues  will  be  described  by  the  display  vector  y(t). 

The  relationships  between  these  displayed  variables  and  the  system  state  is 
given  by 


y(t)  = C(t)  x(t)  (2) 

The  perception  of  these  variables  is  accompanied  with  ein  equivalent  time 
delay,  perceptual  thresholds  and  observation  noises.  Also  the  interference 
between  the  various  visual  cues,  a.o.  arizing  from  the  necessi^-y  to  scan  the 
visual  field  and  to  divide  the  attention  among  the  various  cues,  has  to  be 
considered  (Refs.  7 and  8).  Now,  these  observations  of  the  visual  scene  are 
dealt  with  in  the  same  fashion  as  observations  from  other  sources  (e.g. 
displays,  motion  cues,  etc.).  The  system  state  is  estimated  optimally  (by 
means  of  a Kalman-Bucy  filter)  on  the  basis  of  the  known  (learned)  dynamics 
involved  and  the  observations.  This  state  estimation  process  can  be  considered 
as  an  internal  representation  of  the  task  environment. 


Relationships  between  visual  scene  characteristics  and  the  system  state 

A schematic  version  of  the  visual  scene  (Fig.  1)  can  be  assumed  to 
comprise  textural  elements  and  known  objects.  Both  provide  linear  perspective 
geometrical  cues  (basically,  the  inclination  of  lines)  and  impressions  of 
relative  position  and  velocity. 

The  inclination  , of  a line  element  of  the  visual  scene  is  given  by 

Q = ta.n“’  Y/H  (3) 


where  Y is  the  distance  betwe  n the  observer  and  the  pertinent  line  element 
perpendicular  to  the  looking  direction  and  H is  the  vertical  position  of  the 
observe..'.  Assuming  small  perturbations  (y,  h and  a>)  around  the  trim  condition 
(Y  , H and  Q ) results  after  some  manipulation  (to  a first  order)  in  the 
linear  expression 


w = h + Cy  y (l»a) 

where 

C,  =-sin2«/2H  (Ub) 

h 0 0 


Differentiating  eq  (l*a)  yields  the  expression  for  the  inclination  rate 
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w = C.  R + C y (Uc) 

n y 

The  small  perturbations  of  the  relative  position  and  velocity  of  an 
element  of  the  visual  scene  is  simply  given  by 

“h  ■ ’ “y  “ 

and 

= m ; dy  = y/R 

where  a is  the  visual  angle  and  R is  the  distance  between  the  object  and 
the  observer. 


Furthermore,  when  the  attitude  of  the  observer  (aircraft)  is  taken  into 
account  (with  attitude  angles  (p,  © and ^ ) eqs.  (U)  and  (5)  become 

0)  =C,  h + Cy+(p 

h y 

= h/R  + © (6) 

a = y/E  +(l> 

and  the  corresponding  time-derivatives  o>  = etc. 

Next,  these  expressions  are  utilized  to  describe  the  cues  which  can  be 
derived  from  the  visual  approach  scene. 


Visual  approach  scene 

A schematic  version  of  the  visual  approach  scene  is  shown  in  figure  2. 

The  cues  which  are  assumed  to  be  derived  from  this  scene  are  indicated. 

The  most  important  cue  for  lateral  guidance  is  derived  from  the  inclination 
of  the  runway  sides  and/or  centerline.  The  lateral  deviation  y,  is  zero  if 
the  inclination  of  both  runway  sides  is  the  same  inclination 

of  the  centerline  is  zero  (a>  = O). 

Vertical  guidance  has  to  be  Based  on  the  (average)  inclination  of  the  runway 
sides  when  no  runway  end  and  no  horizon  is  visible.  In  that  case,  the 
observer  has  to  know  the  nominal  inclination  (U  ),  which  is  range-varying. 

The  following  model  analysis  and  experimental  results  will  show  that  a better 
indication  of  the  vertical  position  is  obtained  when  the  length  of  the 
runway  a (or,  almost  equivalently,  the  depression  of  runway  threshold  with 
respect  to  the  horizon)  is  visible.  Also  in  that  case,  the  observer  has  to 
know  the  nominal  depression  which  is,  however,  constant  during  a standard 
approach  (e.g.,  3 deg). 

Glide  slope  information  requires  also  the  estimation  of  the  distance  to 
touchdown.  This  can  be  based  on  the  apparent  size  of  ground  objects,  of  which 
the  most  important  is  often  the  runway  width. 

Aircraft  attitudes  provide  "inner-loop"  information  and  can  be  derived  from 
the  relative  position  and  inclination  of  (e.g.)  the  horizon  and  any  aircraft 
reference.  The  pitch  angle  0,  which  has  to  be  estimated  with  respect  to  its 
(non-zero)  nominal  value  and  the  bank  angle  cp  are  indicated  in  figure  2. 
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MODEL  ANALYSIS 


The  linear  visual  scene  perception  model  (VSPM)  can  be  implemented  in 
the  optimal  control  model  (Refs.  6 and  T).  Based  on  the  foregoing  discussion, 
a variety  of  visual  approach  conditions  are  selected  to  analyze  theoretically. 
In  addition,  an  experimental  program  has  been  conducted  to  provide  a critical 
test  for  the  hypotheses  (assumptions)  underlying  the  model  results.  In  order 
to  obtain  detailed  information  concerning  the  information  processing  involved 
in  the  manual  approach  task,  no  range-varying  effects  are  considered  in  the 
following  analysis.  In  other  words,  it  is  assumed  that  the  aircraft  is  "frozen" 
at  a fixed  poigt  of  the  approach  path  corresponding  with  a nominal  altitude  of 
200  ft  for  a 3 approach  ("hovering").  The  consequence  is  a stationary  process 
involved  allowing  frequency  domain  measuires  such  as  human  describing  functions 
and  observation  noise  spectra.  Especially  the  latter  will  provide  a sensitive 
check  on  the  exactness  of  the  values  used  for  the  model  parameters  under 
investigation.  The  primary  model  parameters  are  the  perceptual  thresholds  of 
the  various  visual  cues  (display  elements)  involved  because  these  represent 
the  most  uncertain  model  parameters.  The  results  of  several  previous 
experimental  studies  suggest  reasonable  acciirate  values  for  the  remaining  model 
parameters . 

Therefore,  base-line  experiments  have  been  conducted  and  relevant  psycho- 
physical literatxire  have  been  searched  resulting  in  reasonable  reliable 
estimates  for  the  perceptual  thresholds  involved.  Finally,  the  last  section 
contains  the  model  analysis  proper  and  the  resulting  model  predictions. 


Visual  scene  configurations 


Referring  to  the  foregoing  discussion  the  configurations  given  in  figure 
3 were  selected  for  the  following  model  analysis  and  formal  experiment. 

Vertical  control  on  the  basis  of  the  inclination  of  the  runway  sides 
can  be  compared  with  the  condition  that  the  depression  of  the  runway 
threshold  below  the  runway  end  (a)  or  below  the  horizon  is  visible 
(configurations  1 and  2).  Furthermore,  the  effect  of  an  aircraft  reference 
providing  explicitly  pitch  information  is  of  interest  (configuration  3). 

Lateral  control  utilizing  the  inclination  of  the  centerline  is 
represented  by  configuration  4.  In  case  the  runway  sides  are  available,  the 
inclination  of  both  sides  has  to  be  estimated  and  compared  with  each  other 
(configuration  5).  A simple  model  analysis  shows  that  this  process  is 
associated  with  the  same  observation  noise  as  in  the  case  of  a center  line. 
Only  the  perceptual  thresholds  involved  are  different  (next  section).  This 
will  be  tested  against  the  experimental  results.  Again  the  effect  of 
explicit  roll  information  provided  by  the  aircraft  reference  is  considered 
by  including  configuration  6.  Configuration  7 concerns  roll  tracking  based 
on  the  aircraft  reference.  This  (presumably)  easy  task  is  included  to  evoke 
some  variation  in  workload  in  order  to  yield  additional  experimental 
evidence  for  the  workload  model  of  reference  8 and  to  test  the  perceptual 
threshold  assumptions  involved. 
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Configxirations  8 and  9 are  selected  to  investigate  the  interference 
between  vertical  and  lateral  control.  It  is  assumed  that  the  pilot  has  to 
divide  his  attention  between  the  various  display  variables  (visual  scene 
cues)  involved.  This  interference  is  assumed  not  only  within  a control  task 
(e.g.  attention  has  to  be  divided  between  pitch  angle  and  altitude)  but  also 
between  vertical  and  lateral  control  when  performing  both  tasks  simultaneously. 
This  represents  a crucial  hypothesis  which  will  be  tested  in  the  following 
as  the  visual  scene  is  widely  assumed  to  represent  integrated  information 
and  it  is  a non-trivial  question  whether  the  visual  scene  can  be  "broken 
down"  into  separate  elements.  Finally,  configuration  10  is  included  to 
investigate  the  effect  of  additional  texture.  This  has,  in  principle,  its 
implications  for  the  information  contents  of  the  visual  scene  which  turned 
out  to  be  of  no  interest  but  also  for  the  psychological  aspects  (perspective 
illusion  and  realism) . 


Perceptual  thresholds 

It  was  anticipated  that  perceptual  threshold  phenomena  could  be 
important  for  the  foregoing  visual  scene  cues.  Thresholds  can  be  accounted 
for  in  the  optimal  control  model  by  modifying  the  observation  noise 
covsiriance  associated  with  a particular  visual  cue. 

Although  the  psychophysical  literature  reports  a wealth  of  emperical 
threshold  data,  these  data  are  known  to  be  affected  by  numerous  experimental 
conditions  which  easily  explains  the  typical  scatter  in  "comparable"  data. 
Therefore,  a baseline  experiment  has  been  conducted  to  determine  the  position 
thresholds  of  the  display  elements  involved  in  the  visual  scene  configurations 
shown  in  figure  3.  These  thresholds  are  primarily  due  to  the  lack  of  explicit 
visual  references  concerning  zero  or  nominal,  visual  scene  conditions. 

This  involves  that  learning  (experience)  and  temporal  cues  (memory 
functioning)  are  important  in  measuring  and  interpreting  thresholds. 

Experimental  details  are  given  in  reference  9*  The  resulting  meas\irements 
are  "translated"  to  values  suitable  for  (as  required  by)  the  describing 
function  representation  for  the  assumed  dead-zone  non-linearity.  The  results 
are  summarized  in  table  1 . 

As  discussed  in  reference  9 thresholds  associated  with  the  perception 
of  motion  in  the  visual  field  can  be  related  to  resolution  properties.  This 
implies  that  the  motion  detection  thresholds  can  be  inferred  from  the  fore- 
going discrimination  data.  The  result  is  also  contained  in  table  1 . 

Apart  from  these  (nominal)  threshold  estimates,  in  table  1 it  is  also 
indicated  how  reliable  these  estimates  are  assumed  to  be.  A sensitivity 
analysis  in  the  following  will  serve  to  relate  this  incertainty  in  threshold 
values  to  a confidence  interval  associated  with  the  system  perfoiTnance 
predictions  of  the  model. 


Model  predictions 


A block  diagram  of  the  control  task(s)  is  given  in  figure  4.  System 
disturbance  enters  the  system  parallel  to  the  control  input.  The  resulting 
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output  is  displayed  to  the  human  operator  as  the  pitch  and  roll  angle  (for 
the  pertinent  configurations)  representing  K-dynamics.  The  integral  of  these 
outputs  are  the  altitude  (or  approach  angle)  and  lateral  deviation  (or  center 
line  inclination),  respectively  (K/s-dynamics) . The  disturbances  are  white 
noise  processed  by  two  first  order  filters  with  poles  at  one  rad/sec  and  two 
rad/sec.  The  disturbance  levels  are  fgr  the  vertical  task  given  by  a 
resulting  pitch  variance  of  0,068  dgg  and  for  the  lateral  task  given  by  a 
resulting  roll  variance  of  10.5  deg  (corresponding  with  the  values  used  for 
the  experimental  program) . Details  concerning  sensitivities  and  gains 
involved  are  contained  in  reference  9* 


Model  parameters  can  be  divided  in  parameters  which  are  constant  for  all 
configurations  and  parameters  which  are  considered  as  the  remaining  model 
variables.  Also  the  experimental  results  of  the  next  chapter  will  be  related 
to  these  (dependent)  variables.  The  key  variables  are  the  perceptual  thresholds. 
The  nominal  values  of  table  \ are  assumed  for  the  model  predictions. 

Furthermore,  the  effect  of  the  upper-  and  lower  threshold,  values  on  the 
system  outputs  is  also  determined  and  discussed  in  the  following  chapter.  The 
overall  level  of  attention  (P  ) is  also,  to  same  extent,  variable,  although 
this  value  has  been  shown  in  previous  studies  to  be  relatively  constant.  A 
nominal  value  of  -20  dB  is  assumed  and  the  effect  of  + 2 dB  on  the  system 
outputs  is  considered. 

The  constant  model  parameters  are:  a neuro-motor  time  constant  of  0.1  sec, 
a perceptual  time  delay  of  0.2  sec  and  a motor  noise  ratio  of  -30  dB. 


Now,  assuming  that  the  human  operator  divides  his  attention  among  the 
visual  cues  (position  and  velocity  of  all  display  elements)  optimally,  i.e., 
minimizing  the  given  cost  functional*  (Ref.  8),  system  performance  can  be 
predicted  for  the  various  configurations.  The  results  are  given  in  table  c!. 


Vertical  control  is  superior  for  the  condition  that  the  runway 
depression  angle  and  the  pitch  angle  can  be  observed  (conf.  3).  The  contri- 
bution of  the  pitgh  information  amounts  to  a 20  ^ reduction  of  the  approach 
angle  variance  {a  of  conf.  2).  When  the  viewing  condition  is  such  that  no 
horizon  or  runway  end  is  visible  and  control  has  to  be  based  on  the  runway 
sides  and/or  co  ) and  runway  threshold  variation  (d)  the  vertical  approach 
performance  is  degraded  substantially.  This  clearly  demonstrates  the 
contribution  of  the  various  visual  cues  involved.  Furthermore,  in  the  case  of 
both  vertical  and  lateral  control,  the  vertical  approach  performance  is 
predicted  to  deteriorate  with  30  ^ to  50  ^ (due  to  the  assumed  interference 
between  both  tasks).  The  last  column  of  table  1 contains  the  (optimal) 
fractions  of  attention  dedicated  to  the  various  cues. 


The  best  lateral  approach  performance  is  obtained  when  the  runway 
centerline  inclination  (a>  ) cue  is  available  (conf.  4).  Lateral  control 
utilizing  the  runway  sides  is  substantially  degraded  (conf*  5)  due  to  the 
larger  perceptual  threshold  of  this  cue.  The  bank  angle  provides  useful 


* According  to  the  instructions  given  to  the  subjects  in  the  experiment 
the  system  output  is  assvmied  to  be  minimized.  In  addition  the  control  rate 
is  weighed  yielding  the  neuro-motor  time  constant  of  0.1  sec. 
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inner  loop  inforaation  (conf.  6).  When  performing  the  vertical  and  lateral 
task  simiiltaneously,  the  model  predicts  a deterioration  in  lateral  performance 
(confs,  8 and  9)  of  about  100  The  model  predicts  that  the  effect  of  the 
texture  (conf.  10)  on  system  performance  is  negligible. 

The  effect  of  the  model  parameter  variations  (thresholds  and  overall 
attention)  on  the  system  scores  and  additional  theoretical  results  will  be 
discussed  in  the  next  chapter  where  the  model  predictions  will  be  compared 
with  the  experimental  results. 


EXPERIMENTS 


The  first  objective  of  the  experimental  program  was  to  test  the  fore- 
going model  results  with  respect  to  both  the  fundamental  hypotheses  involved 
(optimality  in  control  and  attention  allocation,  interference  between  cues) 
and  the  assumed  numerical  values  of  the  key  model  parameters.  Secondly,  in 
case  significant  discrepancy  occurs  between  model  and  experimental  results 
the  appropriate  adjustments  can  (hopefully)  be  made  in  the  model  assumptions 
underlying  the  model  results. 


Experimental  procedures 

The  same  10  configurations  as  discussed  previously  are  investigated  in 
the  experimental  program.  These  configurations  were  four  times  presented  to 
the  (foTir)  subjects  (general  aviation  pilots)  in  a random  order.  Each  run 
lasted  200  sec.  Between  the  runs  the  subjects  were  asked  to  give  their 
impression  of  the  exerted  workload  (Reference  9 contains  the  rating  scales 
used  and  additional  experimental  details).  The  subjects  were  instructed  to 
minimize  the  mean-squared  system  output.  They  were  trained  on  the  ten 
configurations  in  a random  order  till  a relatively  stable  performance  level 
was  reached.  All  together,  about  250  training  trials  were  performed. 

An  analog  computer  was  used  to  simulate  the  vehicle  dynamics  and  to 
generate  the  visual  scene  characteristics.  This  visual  scene  was  presented  to 
the  subjects  on  a TV  monitor  located  2.5  m in  front  of  their  point  of  regard. 
They  manipulated  a two-axis  isometric  hand  control.  The  system  parameters 
were  recorded  on  FM  magnetic  tape  for  off-line  mean-squared  scores  and 
frequency  domain  computations  . 

Comparison  of  experimental  results  and  model  scores 

In  this  section  the  experimental  results  in  terms  of  mean-squared 
performance  scores  are  compared  with  the  model  predictions.  Based  on  the 
results  of  table  2 firstly  the  approach  angle  (a)-  and  centerline  inclination 
(co  ) scores  are  considered  (the  model  predicts  attitude-  and  control  scores 
which  are  relatively  insensitive  over  the  configurations). 


^ Unfortunately,  these  frequency  domain  data  were  not  available  in  time  to 
include  in  this  paper.  These  results  will  be  included  in  reference  9* 
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Apart  from  the  nominal  model  predictions  (of  table  2)  the  effect  of  the 
uncertainty  in  underlying  assumptions  (i*e.*  numerical  values  of  the  thres- 
holds a.i  overall  attention)  on  system  performance  is  determined*  For  the 
upper-  and  lover  threshold  values  given  in  table  1 and,  in  addition,  + 2 dB 
and  -2  dB  variation  in  overall  attention  the  corresponding  performance  scores 
are  determined.  It  is  hypothesized  that  the  experimental  scores  lie  within 
the  resulting  performance  interval. 

In  figures  5 and  6 both  the  experimental  means  and  standard  deviations 
(of  16  runs)  and  the  model  predictions  are  given.  For  all  single-axis  tasks 
the  experimental  scores  lie  well  within  the  predicted  interval.  This  indicates 
not  only  that  the  model  is  "right"  but  also  that  the  assumed  numerical 
values  for  the  thresholds  and  overall  attention  are  close  to  the  "real" 
values . 

For  the  dual-axis  tasks  the  experimental  results  do  clearly  not  match 
the  model  predictions.  The  experimental  data  of  configuration  9 and  10  have 
been  pooled  because  both  the  model  predictions  and  the  experimental  results 
for  both  configxirations  indicate  that  the  only  effect  of  the  texture 
information  is  the  enhancement  of  the  perspective  illusion.  This  was  also 
apparent  during  the  learning  phase.  An  adjustment  of  the  model  parameter 
values  (which  has  to  be  appropriate  for  the  single-axis  tasks  as  well)  does 
not  result  in  a good  agreement  with  the  experimental  scores.  Therefore,  it 
is  tentatively  concluded  that  the  assumed  hypothesis  of  interference  between 
the  two  tasks  has  to  be  rejected.  Instead,  the  following  hypothesis  is 
considered:  the  visual  scene  stimulates  the  human  operator  to  perform  the 
dual-axis  task  just  as  well  as  the  single-axis  task  (thus,  vertical  control 
is  not  degraded  when  the  lateral  control  task  is  added,  and  vice  versa).  So, 
it  is  assumed  that  there  is  ^ performance  interference.  This  will  be  further 
discussed  in  the  following. 

Comparing  also  the  attitude  scores  (9  and  cp)  and  the  control  scores 
(6  and  6 ) of  the  model  predictions  in  table  1 and  the  measured  scores 
given  in  liable  3 it  is  apparent  that  both  the  measured  attitude  scores  and 
the  measured  control  scores  are  much  lover  than  predicted.  This  indicates 
that  the  subjects  (being  pilots)  performed  the  - to  some  extent  realistic 
appearing  - "approach"  tasks  in  a much  smoother  fashion  than  the  model 
predicts  on  the  basis  of  an  assumed  neuromotor  time  constant  of  0.1  sec.  This 
is  confirmed  by  pilot  commentary  indicating  that  the  pilots  were  reli.Qtant  to 
make  rapid  control  movements  and  "chase  the  needles". 

Based  on  this  observation  the  neuromotor  time  constant  was  adjusted  to  a 
value  of  0.25  sec.  This  value  which  was  kept  constant  in  the  following 
analysis  is  apparently  more  representative  for  outer-loop  control  behavior. 

In  addition,  figure  5 suggests  that  for  the  vertical  control  tasks  a better 
agreement  between  measured  and  model  results  will  be  obtained  when  the  lover 
threshold  values  given  in  table  2 will  be  assumed  (0.2  /sec  and  0.4  )•  This 
is  the  only  minor  adjustment  of  the  model  variables. 

The  resulting  model  scores  are  compared  with  the  measured  mean-squared 
values  in  table  3*  In  general,  the  agreement  between  the  measurements  and 
the  refined  model  scores  is  quite  good.  Now  (with  a neuromotor  lag  of  0.25 
sec)  the  control  scores  match,  on  the  average,  very  well.  The  same  can  be 
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said  of  the  system  outputs  a and,  to  less  extent,  a>  . 

A comparison  of  the  pitch  attitude  scores  shows  tha?  the  pilots  were  somewhat 
more  conservative  in  making  pitch  corrections  than  the  model  predicts  (apart 
from  configuration  1 ) . These  lower  pitch  scores  ( and  the  corresponding  some- 
what lower  control  scores)  could  easily  be  duplicated  by  the  model,  however, 
by  an  appropriate  weighting  of  the  pitch  angle.  The  mean-squared  roll  angles 
match  again,  rather  well*. 

The  system  output  scores  are  summarized  in  figure  ?•  For  the  dual-axis 
configurations,  both  the  scores  corresponding  with  the  assiamption  that  there 
no  performance  interference  between  the  two  axes  and  the  "full  interference" 
scores  are  indicated.  The  resxtLts  strongly  support  the  hypothesis  that  there 
is  no  interference  between  the  vertical-  and  lateral  axis  thanks  to  the 
visual  scene. 

In  summary,  it  can  be  concluded  that  for  the  relatively  realistic,  outer- 
loop  control  tasks  under  investigation  a neuromotor  time  constant  of  (say) 

0.25  sec  is  appropriate.  Furthermore,  only  one  minor  adjustment  of  the 
nominal  model  variables  was  required  to  yield,  on  the  average,  a good 
agreement  between  model  results  and  measurements; .a  position  threshold  for  a 
and  © of  O.U°  and  a velocity  threshold  for  d and  0 of  0.2  /sec  (the  same 
value  as  found  in  reference  lO).  Finally,  the  experimental  results  provided 
convincing  support  for  the  hypothesis  that  the  visual  scene  perception 
process  can  be  described  on  the  basis  of  the,  mutually  interfering,  various 
(separate)  visual  cues  considered.  There  is  no  performance  degradation 
(interference)  when  both  the  vertical  and  lateral  control  task  are  performed 
simultaneously . 


Workload  model  results  and  subjective  ratings 

Using  the  foregoing  model  results  human  operator  workload  can  be  computed. 
The  workload  model  (a.o.  discussed  in  reference  8)  involves  not  only  the 
level  of  attention,  P , dedicated  to  the  task  in  accordance  with  the  model 
of  reference  1 1 , but  also  the  aspect  of  arousal  ( "vincertainty " ) . 

The  model  predictions  are  compared  in  figxire  8 with  subjective  ratings 
on  the  workload  scale  given  in  references  8 and  9*  Apart  from  configuration 
1 the  linear  correlation  between  subjective  ratings  and  workload  model 
predictions  is  quite  good  (r  = 0.88).  This  result  provides  additional 
support  for  the  workload  model. 

The  model  predicts  a much  lower  workload  level  for  configuration  1 than 
reflected  by  the  subjective  ratings.  The  explanation  for  this  is  that  for 
this  configuration  the  subjects  were  not  sure  what  the  right  (nominal) 
vertical  position  was.  Not  only  they  learned  slowly  on  this  configuration 
(somewhat  discouraged  by  their  varying  learuini'.-performance)  but  also  they 
clearly  did  not  like  the  uncertainty  involv.-.i  in  performing  the  task  which 
can  also  be  related  to  training.  So,  the  model,  not  including  this  learning 
aspect,  predicts  that  the  workload  corresponding  with  this  configuration  will 


* For  the  roll -only  task  (conf.7)  an  overall  level  of  attention,  P , of 
-18  dB  had  to  be  assumed  in  order  to  match  the  measured  scores. 
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substantially  reduce  when  the  subjects  are  more  trained  on  (familiar  with) 
this  task. 


CONCLUSIONS 


The  visued  scene  provides  a variety  of  perspective  geometrical  and 
relative  motion  cues.  The  experimental  results  have  supported  that  these 
characteristics  can  be  considered  as  separate  cues  among  which  the  human 
operator  has  to  divide  his  attention.  The  commonly  accepted  idea  that 
pictorial  information  is  better  integrated  (less  interfering)  than  separate 
display  elements  is  in  the  present  study  specifically  demonstrated  in  that 
there  is  no  performance  interference  between  the  vertical  and  lateral  task. 
Both  the  workload  model  results  and  the  subjective  ratings  indicate  that 
the  workload  is  increased  indeed  when  performing  both  tasks. 

In  the  case  of  guidance  control  tasks  (e.g.,  the  visual  approach  task) 
pilots  are  reluctant  to  make  rapid  control  movements.  This  is  represented 
in  the  optimal  control  model  by  a weighting  on  control  rate  corresponding 
with  a neuromotor  time  constant  of  about  0.25  sec.  This  outer-loop  control 
behavior  is  distinguished  from  attitude  (inner-loop)  control  tasks  which 
can  be  modelled  with  a neuromotor  time  constant  of  0.1  sec  (Ref.  7). 

Furthermore,  the  assumptions  concerning  the  key  parameters  of  this 
investigation,  i.e.  the  perceptual  thresholds,  could  (indirectly)  be 
checked  against  the  experimental  data.  Apart  from  one  minor  adjustment  the 
a priori  assumed  threshold  values  yielded  a good  agreement  between  model 
scores  and  measurements.  The  sensitivity  analysis  visualized  in  figures  5 
and  6 indicates  that  this  result  allows  a reasonable  accurate  verification 
of  the  underlying  model  parameters  (thresholds  and  level  of  attention). 

Finally,  the  workload  model  predictions  have  been  confirmed  convincingly 
by  subjective  ratings.  Apart  from  configuration  1 (the  performance  of  which 
task  must  have  been  dominated  by  a psychologigal  effect  not  included  in  the 
model)  the  lineai*  correlation  between  model  predictions  and  subjective 
ratings  was  0.9* 
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Table  2 Model  predictions 


a)  VERTICAL  CONTROL 


Configxiration 

ff^(deg^) 

</g(deg^) 

*e 

attention 

allocation 

f. 

1 

1 

0.211 

O.2I42 

57.6 

mm 

2 

0.121 

0.239 

57.3 

■iBSESHi 

— 

3 

0.103 

O.2U7 

58.8 

* 0.6 
a 

fe  -o.U 

8 

0.156 

0.319 

70.2 

f * 0.42 
a 

f.  » 0.13 

a 

9 

0.157 

0.331 

72. u 

f « 0.06 
a 

f.  = 0.27 

f°  .0.23 

b)  UTERAL  CONTROL 


Configuration 

c 

tf^(deg^) 

2 /„2> 
(N  ) 

a 

attention 

allocation 

f. 

1 

4 

1.86 

9.68 

13.1 

f » 0.37 

to 

C 

f.  = 0.63 

C 

5 

4.22 

14.7 

15.7 

~ _ Q 1^2 

Ui 

e 

f.  » 0.58 

Ui 

c 

6 

2.96 

9.35 

12.9 

f » 0.35 

Ui 

c 

f = 0.65 

8 

8.01 

24.8 

20.9 

■HH 

9 

6.71 

19.6 

18.2 

f * 0.22 

Ui 

C 

f » 0.22 

Table  3 Comparison  of  measured  scores  and  model  results 


VERTICAL 

CONFIGURATION 

MS^(deg^) 

MS^(deg^) 

MS.  (M^) 
0 

e 

1 

model 

0.189 

0.095 

26.7 

measured 

0.193 

0.098 

26.4 

2 

model 

0.082 

0.096 

26.9 

measured 

0.077 

0.054 

23.0 

3 

model 

0.072 

0.091 

26.4 

measured 

0.081 

o.oW 

21.2 

8 

model 

0.085 

0.110 

28.4 

measured 

0.083 

0.06l 

24.6 

9,  10 

model 

0.072 

0.0S5 

26.9 

measured 

0.065 

o.oi*o 

20.1 

UTERAL 

CONFIGURATION 

MS^  (deg^) 
c 

MS  (deg^) 

MSj^  (N^) 
a 

4 

model 

2.78 

5.82 

9.76 

measured 

3.62 

7.82 

10.9 

5 

model 

5.42 

8.40 

10.6 

measured 

4.72 

..  _ 7.90 

10.9 

6 

model 

3.40 

5.46 

measured 

3.99 

5.43 

7 

model 

2.89 

measured 

2.99 

8 

model 

6.37 

10.0 

11.2 

measured 

6.20 

12.1 

i4.o 

9.  10 

model 

4.14 

6.66 

10.8 

measured 

4.52 

10.8 

549 


1«  OUTSIDE  VIEW 


U RELATIVE  MOTION  OF  THE  VISUAL  FIELD 


Fig.  1;  Visual  scene 
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F.ig.  2:  Cues  derived  from  the  visual  scene 


N.B.  CONFIGURATION  7 CONCERNS  ROLL  TRACKING  BASED  ON  ROLL  BAR  ONLY 

Fig.  i:  Viewing  conditions  and  s'‘lected  configurations 
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SYSTEM 

DISTURBANCE,  w 


CONFIGURATIONS 


Fig*  5:  Comparison  of  experimental  scores  and  model 

predictions  - vertical  control 


552 


PB161NAL  PAGE  IS 
DE  POOR  QUALITY 


(«)  (5)  (8)  (8)  (9).  (10) 

CONFIGURATIONS 

Fig.  6:  Comparison  of  experimental  scores  and  model 

predictions  - lateral  control 
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CONFIGURATIONS 


Fig*  7:  Refined  model  scores  and  experimental  results 
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Fig,  8:  Subjective  workload  ratings  and  computed  workload 
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LINEAR  MODELLING  OF  ATTENTIONAL  RESOURCE  ALLOCATION^ 

2 

by  Byron  Fierce  and  Christopher  D.  Wickens 
University  of  Illinois  Department  of  Psychology 


SUMMARY 


Eight  subjects  time*shared  performance  of  two  compensatory  tracking 
tasks  under  conditions  when  both  were  of  constant  difficulty,  and  when  the 
control  order  of  one  task  (designated  primary)  was  varied  over  time  within 
a trial.  On  line  performance  feedback  was  presented  on  half  of  the  trials. 
The  data  are  interpreted  in  terms  of  a linear  model  of  the  operator's  atten- 
tion allocation  system,  and  suggest  that  this  allocation  is  strongly  subop- 
timal.  Furthermore  the  limitations  in  reallocating  attentional  resources  be- 
tween tasks,  in  response  to  difficulty  fluctuations  were  not  reduced  by  aug- 
mented performance  feedback.  Some  characteristics  of  the  allocation  system 
are  described,  and  reasons  for  its  limitations  suggested. 


INTRODUCTION 


A common  requirement  imposed  upon  the  human  operator  engaged  in  time- 
sharing performance  under  time-varying  environmental  conditions  results  when 
changes  occur  in  the  difficulty  of  one  of  two  concurrently  performed  tasks, 
as  its  performance  constraints  ate  held  constant.  Such  changes  thereby  force 
a reallocation  of  attentional  resources  toward  the  task  whose  difficulty  is 
increasing.  Thus  for  example  in  precision  flight,  an  increase  in  lateral  air 
turbulence  will  require  re-allocatlon  of  resources  away  from  tasks  of  lesser 
demand  (conmunications,  pitch  control)  toward  control  along  the  lateral  axis. 

The  entire  process  of  task  demand  evaluation  and  resource  allocation 
can  be  conceptualized  as  a two  stage  process.  The  operator  must  first  eval- 
uate the  error,  or  discrepancy  between  desired  and  actual  performance  on 
the  task  or  tasks  required  (error  evaluation).  If  such  an  error  is  per- 
ceived to  exist,  the  attention  allocation  system  then  must  respond  by  ahift- 
ing  resources  in  a manner  to  restore  the  desired  level  of  performance  and 
nullify  the  original  error  (resource  allocation).  This  closed  feedback  loop 
describing  the  resource  allocation  system  is  analogous  in  some  respects  to  a 
compensatory  tracking  task,  in  which  position  error  is  evaluated  and  a manual 
control  response  is  executed  to  nullify  the  error.  Because  of  this  similar- 
ity, modelling  techniques  borrowed  from  manual  control  will  be  utilized  in 

iThis  research  was  supported  by  a grant  from  Air  Force  Office  of  Scienti- 
fic Research  Life  Sciences  directorate.  AFOSR77-3380.  Dr.  Alfred 
Fregly  was  Che  contract  monitor. 

^Now  at  Williams  Air  Force  Base. 
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the  current  Investigation  to  describe  and  evaluate  the  human's  attention 
allocation  system. 

Delp  and  Crosaman  (Reference  1)  have  provided  an  analytical  framework 
for  describing  the  linear  relation  between  time-varying  task  parameters  and 
single  task  performance  in  terms  of  a higher  level  "meta  transfer  function." 
The  objective  of  the  present  research  is  to  apply  similar  procedures  to  anal- 
yze the  meta  transfer  function  of  the  resource  allocation  system  to  task  de- 
mand (difficulty)  changes  in  the  dual  task  environment.  In  the  paradigm  em- 
ployed, subjects  perform  two  concurrent  tracking  tasks.  One  task  is  desig- 
nated as  primary'-a  high  priority  task  whose  performance  is  to  be  maintained 
at  or  above  some  criterion  for  the  duration  of  a trial.  During  the  trial, 
the  difficulty  of  the  primary  task  is  variled  in  a semi-periodic  fashion.  It 
is  assumed  that,  to  the  extent  that  he  is  capable,  the  subject  follows  the 
priority  instructions,  and  primary  task  performance  remains  constant  in  the 
face  of  varying  primary  task  difficulty.  To  achieve  this  optimal  allocation 
behavior,  the  subject  is  therefore  required  to  withdraw  processing  resources 
from  performance  of  the  secondary  task,  and  its  performance  should  then  vary, 
more  or  leas  phase-locked  to  the  difficulty  Vwriatlons  of  the  primary  task. 

An  hypothetical  example  of  this  "optimum  allocation  response"  to  a 
ramp  increase  in  primary  task  difficulty  is  depicted  by  the  solid  lines  of 
Figure  1.  The  time- varying  performance  on  both  tasks  is  portrayed,  along 
with  the  inferred  allocation  of  processing  resources  between  the  tasks. 

Note  the  differential  sensitivity  of  primary  vs.  secondary  task  performance 
to  the  increase  in  primary  task  difficulty,  and  the  corresponding  optimum 
allocation  of  resources.  Naturally,  other  varieties  of  allocation  responses 
may  be  observed  as  well.  The  dashed  lines  in  Figure  I depict  that  of  a non- 
optimum allocator  in  which  resources  are  not  at  all  redistributed,  and  pri- 
mary task  performancr  varies  with  its  difficulty.  Naturally  a hybrid  response 
between  that  of  the  optimal  and  nonoptimal  allocator  is  possible,  in  which 
there  is  '*)me  reallocation  of  resources,  but  in  insufficient  degree  to  meet 
the  new  primary  task  demands. 

The  model  that  will  be  employed  to  describe  the  allocation  system  is 
portrayed  in  Figure  2.  Here  the  allocation  system  is  assumed  to  be  a linear 
dynamic  system  in  the  sense  that  it  receives  inputs  (task  demands  and  sub- 
jectively assessed  performance)  and  generates  outputs  in  response  (mobilized 
processing  resources).  While  these  outputs  cannot  be  directly  observed,  they 
may  be  inferred  from  an  appropriately  filtered  on-line  performance  measure. 
Thus  in  dual  task  performance,  depicted  in  Figure  2,  the  dynamic  relation 
between  the  four  inputs  to  the  allocation  system  (difficulty  and  performance 
demands  on  both  tasks)  and  the  two  outputs  (iask  performance  on  each  task) 
can  be  evaluated  to  determine  the  extent  to  which  these  are  described  by  a 
linear  transfer  function  or  orderly  mathematical  relation.  Such  a procedure 
is  analogous  to  the  analysis  of  dual  axis  tracking  (Reference  2). 

When  analyzing  dual  task  performance,  one  may  examine  for  each  task,  the 
sensitivity  of  its  allocated  resources  (inferred  from  performance)  to  changes 
in  its  own  difficulty  (D.Pj^  and  D2?2  Figure  2)  and  to  changes  in  the  dif- 
ficulty or  performance  or  the  concurrent  task  (D]^P2 
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Figure  1.  Hypothetical  response  depicting  optimal  allocation  adjust* 
ment  (solid  lines)  and  nonoptlmal  allocation  (dashed  lines) 


Figure  2.  Schematic  representation  of  dual  task  performance 


current  study  Fourier  analysis  will  be  empltyed  to  detennine  the  relations  be* 
tween  time*varylng  inputs  (tracking  task  difficulty)  and  time*varying  outputs 
(filtered  performance).  To  the  extent  that  the  resource  allocation  system 
is  sensitive  at  all  to  these  variations,  the  linear  coherence  measure,  cor- 
relating variations  over  time  between  the  input  and  output  signals,  should 
be  non*sero.  More  specifically  the  cross-channel  (D^P^  like- 

channel  (D.P.  and  ^2^2^  coherence  measure  will  be  examined  as^a^means  of 
determining  Che  optimality  of  the  allc'-atlon  system.  For  a highly  optisial 
system,  the  like  channel  coherence  <D^P.;  should  be  a low  (near  0),  with  the 
crosschannel  coherence  (D1P9)  (ndaV  1.0).  For  the  Aon-optisMl  allocator 

the  values  should  be  reversed,  and  for  the  hybrid  case  both  coherence  values 
should  be  relatively  high. 
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If  suboptimal  allocation  is  observed  in  the  present  results,  then  an 
important  question  that  can  be  asked  relates  to  the  source  of  the  limits* 
tion  in  the  allocation  system.  In  terms  of  the  two*phase  description  of  the 
allocation  process  as  shown  in  Figure  2,  one  may  ask  whether  the  limitation 
results  from  the  operator's  inability  to  perceive  discrepancies  between 
desired  and  actual  performance  (failure  of  error  evaluation),  or  from  the 
inability  to  reallocate  resources  in  response  to  an  accurately  evaluated 
error.  In  an  analogous  manner  it  is  possible  to  ask  whether  inadequate  per* 
formanc  in  a compensatory  tracking  task  results  from  poor  perceptual  eval- 
uation of  the  displayed  error,  or  from  an  inability  to  execute  an  appropriate 
control  response. 


To  investigate  the  source  of  potential  limitations,  a separate  set  of 
experimental  conditions  were  included  in  which  the  conventional  instan- 
taneous tracking  error  display  was  supplemented  by  augmented  performance 
feedback  that  displays  the  discrepancy  between  the  desired  level  of  primary 
task  performance,  and  the  running  average  of  that  performance  (e.g.,  Reference 
3).  To  the  extent  that  limitations  in  the  allocation  system  result  from 
inadequate  error  evaluation,  rather  than  limits  of  allocation,  then  the  ex- 
plicit display  of  the  discrepancies  in  performance  should  produce  a corres- 
ponding approach  toward  optimality  of  allocation  (i.e.,  an  increase  in  the 
cross -channel,  and  decrease  in  the  like-channel  coherence). 


METH(» 


Tasks . Subjects  performed  two  compensatory  tracking  tasks,  displayed 
one  above  the  other  with  a slight  horizontal  offset.  The  left  display  was 
controlled  by  left-right  manipulation  of  a spring  loaded  controller  held  in 
the  left  hand.  The  right  display  was  similarly  controlled  with  the  right 
hand.  The  total  visual  angle  subtended  by  both  displays  was  4^  (horizontal) 

X 1°  (vertical).  Disturbance  inputs  consisted  of  band-limited  white  noise 
with  an  upper  cutoff  frequency  of  .32  Hz.  Separate  uncorrelated  disturbances 
were  employed  on  each  task  and  were  added  to  the  output  of  the  control  dynam- 
ics. Control  dynamics  were  of  the  form: 

^ . -2,-) 

On  trials  of  constant  difficulty,  the  value  of  the  difficulty  parameter 
alpha  was  set  at  .50.  On  variable  difficulty  trials,  the  value  of  alpha  on 
one  task,  designated  primary,  was  driven  by  the  function:  a ••  .50  + Sin 
(.1884  t)  -t*  Sin  (.0628  t),  (0  < Q(  < 1).  This  produced  a system  that  var- 
ied continuously  between  second  order  unstable  dynamics,  first  order  stable 
dynamics,  and  intermediate  levels  in  a series  of  spikes  and  ramps  (see 
Figures  3 and  4).  Secondary  task  difficulty  was  always  held  constant  with 
alpha  ■ .50. 

Supplementary  performance  feedback  of  the  primary  task,  used  in  variable 
difficulty  trials,  appeared  as  a bar  graph  varying  in  height  to  reflect 
changes  in  performance  (Reference  3).  The  performance  bar  represented  In- 
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Cegrcted  primary  task  error,  averaged  over  a sliding  3*second  window.  The 
desired  performance  level.  Indicated  by  a short  horizontal  line  positioned 
about  half  the  distance  from  the  zero  point  (no  bar  graph  showing)  to  the 
top  of  the  display,  reflected  the  subject's  average  performance  assessed  for 
trials  of  constant  difficulty.  By  tracking  so  that  the  bar  graph  remained  at 
or  above  the  desired  performance  line,  the  subject  attained  desired  standards 
of  primary  task  performance. 

Root  mean  squared  error  (BMSE)  was  computed  on  line  for  each  task  and 
recorded  at  the  end  of  each  trial.  Control  stick  and  cursor  error  posi- 
tions were  sampled  and  recorded  on  tape  every  120  msec.  Experimental  control 
was  governed  by  a Raytheon  704  computer. 

Design  and  Procedure.  Eight  right-handed  male  students  at  the  Univer- 
sity of  Illinois  participated  In  the  experiment  and  were  paid  for  participa- 
tion. A wlthln-subjects  design  was  employed  so  that  all  subjects  performed 
all  experimental  conditions.  Following  one  day's  session  of  practice  on  the 
dual  axis  tracking  tasks,  four  experimental  sessions  were  conducted.  Within 
each  session,  subjects  performed  24  two  minute  dual  task  trials.  These  con- 
sisted of  8 trials  of  constant  difficulty,  of  which  the  final  4 were  used 
for  data  analysis  (Phase  I),  followed  by  12  trials  of  variable  difficulty,  of 
which  the  final  8 were  used  for  data  analysis  (Phase  2).  Finally  the  subjects 
received  four  more  trials  of  constant  difficulty  (Phase  3).  During  constant 
difficulty  trials  subjects  were  Instructed  that  the  two  tasks  were  of  equal 
priority,  while  In  Phase  2,  the  task  of  variable  difficulty  was  designated 
as  primary--lts  performance  to  be  held  constant.  On  alternating  Phase  2 
trials,  either  the  left  hand  task  or  the  right  hand  task  was  primary  (and  was 
therefore  variable).  Similarly  on  alternating  pairs  of  Phase  2 trials,  sup- 
plemental feedback  was  either  present  or  absent. 


RESULTS 


RMS  Error.  Two  1-way  repeated  measure  analyses  of  variance  were  per- 
formed on  the  RMS  tracking  errors,  one  for  primary  and  one  for  secondary  task 
performance.  The  four  levels  of  each  ANOVA  consisted  of  Phase  1,  Phase  2 
feedback.  Phase  2 no-feedback,  and  Phase  3.  The  effect  of  condition  on  the 
performance  measures  In  both  AMOVAs  was  highly  reliable  (Primacy  Ta»  , 

F3  -f  107.98,  p < .001;  Secondary  Task,  F,  21  " 54.93,  p < .001).  The 
meAn  values  of  primary  and  secondary  task  ertor  for  the  four  conditions 
are  shown  In  Table  1.  It  Is  apparent  that  large  differences  In  both  tasks 


Table  1: 

RMS  Error  (Proportion 

of  Scale 

Phase  1 

Phase  2 Feedback  Phase 

2 No  Feedback 

Phase  : 

Prlsiary  Task 

.1164 

.1808 

.1869 

.1166 

Secondary  Task 

.1206 

.2058 

.1806 

.1147 

vere  evident  between  the  verieble  (Phaee  2)  and  constant  difficulty  (Phases  1 
and  3)  trials,  a difference  substantiated  by  the  experisiental  contrast  of 
Phase  1 with  Phase  3 no- feedback  (Primary  Task,  P«  ^ " 153.0,  p < .001;  Sec- 
ondary Task,  F.  . « 31.8,  p < .001).  The  effect  of' feedback,  however,  exam- 
ined in  the  contrast  between  the  two  Phase  2 conditions,  was  only  reliable 
for  the  Secondary  Task  (P^^  ^ ■ 59.03,  p < *001). 


Coherence  Analysis.  The  response  of  performance  to  the  time-varying 
changes  in  task  difficulty  is  illustrated  in  Figures  3 (feedback)  and  4 
(no- feedback).  The  error  measures  were  smoothed  by  aversging  tracking  SMS 
error  within  a sliding  2.4  second  window.  These  smoothed  performance  re- 
cords were  then  ensembled  over  trials  and  subjects  to  produce  the  date  por- 
trayed in  Figures  3 and  4,  It  is  evident  in  these  figures  thst  to  some  ex- 
tent performance  on  both  tasks  ’’tracked"  the  tiaw-varying  difficulty  para- 
meter, an  observation  that  was  bom  out  by  the  analysis  of  linear  coherence. 


The  linear  coherence  analysis  employed  a Fast  Fourier  Transform  tlgor- 
ithm  (Reference  4)  to  transform  tine  variations  of  primary  task  alpha  and 
within  trial  error  omasures  to  power  spectra  in  the  frequency  doouiin.  From 
these  transformed  messures,  linear  coherence  values  (Reference  5)  were  com- 
puted correlating  variations  over  time  between  Primsry  Task  difficulty  (alphs 
level)  and  the  performance  measures  (within  trial  error  averages)  on  both 
tasks. 


Obtsined  linear  coherence  values,  assessed  at  the  six  lowest  frequency 
vslues  that  best  sccount  for  variations  of  the  task  one  alphe  signsl,  are 
displayed  in  Figure  5.  It  is  evident  in  Figure  5 that  linear  coherence  is 
reasonably  high  in  both  conditions  for  both  measures.  However,  primary  task 
difficulty  fluctuations  sema  to  Induce  greater  variation  in  primary  taox  than 
in  secondary  task  performance.  Similarly  feedback  demonatrated  little  ef- 
fect on  primary  task  coherence  but  a small  but  consistent  effect  on  the  co- 
herence with  the  secondary  task. 


DISCUSSION 


The  most  striking  aspect  of  the  data  relates  to  the  marked  deteriora- 
tion in  performance  on  both  tasks  that  results  when  the  difficulty  of  one  is 
made  variable.  This  was  manifest  in  s 60-7(R  increase  in  RMS  error,  despite 
the  feet  that  the  average  value  of  the  difficulty  parameter  alpha  (•■  .50) 
in  the  variable  difficulty  tasks  was  equivalent  to  its  value  in  the  constant 
condition. 

A reasonable  explanation  for  this  difference  can  attribute  the  perfor- 
mance decrement  to  the  higher  level  cognitive  process  required  to  deal  with 
varying  task  rlemandr,  in  an  effort  to  meat  performance  requiresKinta . In 
short,  the  aperation  of  the  attention  allocation  system  itself  requires 
processing  resources  in  order  to  function  in  continuously  reevaluating  and 
responding  to  resource  desmed  changes. 
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Figure  S.  Linear  coherence  veluea 
bctifcen  alpha  and  track- 
ing error  ■eaaurea 


Figure  6.  Gain  plot  of  tranafer 

function.  Ratio  of  track- 
ing error  (range  0-1.0) 
to  alpha. 


Pronertlea  of  the  Allocation  gyatew.  The  propoaltlon  that  the  aysten 
■ay  be  ■odelled  approxlwatcly  aa  a linear  dsnuuale  ayatea  received  aoaw  aup- 
port  in  the  current  reaulta,  both  fron  the  relatively  high  linear  coherence 
valuea  obtained  at  the  frequenclea  correapondlng  to  difficulty  variation, 
and  on  the  baala  of  vlaual  exaalnatlon  of  Flgurea  3 and  4.  In  addition  to 
the  general  reaponalveneaa  of  perfomnnce  on  both  taaka  to  the  df  fflculty 
fluctuatlona  deacrlbed  above,  two  additional  characterlatlca  of  theae  flg- 
urca  that  are  not  revealed  by  the  coherence  analyala  are  particularly  rele- 
vant. 


1.  The  tranafer  function  of  the  alpha-perfonuincc  data  waa  coaputed, 
and  the  aaplltudc  ratio  data  are  plotted  In  the  gain  portion  of  tint  Bode  plot 
ahown  In  Figure  6.  Uhllc  the  linear  correlation  of  thla  alope  la  not  high, 
and  the  ntaabar  of  polnta  (6)  la  too  few  to  allow  any  atrong  conclualona,  the 
Implication  of  theae  data  la  that  the  reaponae  of  the  allocation  ayatea,  a^ 
Inferred  fro«  aubjecta*  performance  la  to  lead  the  difficulty  variation  aa  a 
KS  ayatem.  That  la,  performance  la  aenaltlve  to  the  rate  of  change  or  flrat 
derivative  of  difficulty,  rather  than  to  the  abaolute  level  of  difficulty 
Itaelf.  Thla  behavior  la  graphically  llluatrated  *.n  the  reaponae  of  prlaMry 
taak  performance  to  the  aplke  Incrcaao  In  alpha  at  time  t ■ 72  i.r  Flgurta  3 
and  4.  Thla  reault  la  In  cimtraat  to  that  obaerved  by  Delp  and  Croaaman 
(Reference  1),  who  modelled  the  performance  reaponae  to  difficulty  changea 
(their  "■ata"-tranafer  function)  aa  a flrat  order,  K/S,  or  Integral  ayatem. 
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The  source  of  this  difference  is  not  immediately  apparent;  it  may  be  attribu- 
table to  either  the  repeated  nature  of  the  difficulty  function  employed  in 
the  current  study  that  allowed  the  subjects  some  degree  of  anticipation,  to 
the  discrete  steplike  changes  of  that  function,  or  to  the  dual  task  environ- 
ment used  here. 

2.  Both  figures  indicate  the  presence  of  relatively  high  frequency 
oscillations  in  secondary  task  performance  that  do  not  correspond  to  varia- 
tions in  alpha.  While  these  oscillations  might  at  first  be  described  as 
"noise,"  it  should  be  noted  that  they  correspond  very  closely,  point-for- 
point  in  time  between  the  separate  and  independent  replications  depicted  in 
Figures  3 and  4.  A close  correspondence  of  this  nature  would  not  be  pre- 
dicted from  random  variability  in  the  two  replications.  Instead,  these  os- 
cillations bear  a resemblance  to  the  frequency  response  that  a second  order 
physical  system  with  spring  loading  might  show  to  a step  or  impulse  input, 
approximating  the  nature  of  the  difficulty  changes  presently  employed. 

While  the  precise  nature  or  source  of  these  oscillations  cannot  be  estab- 
lished, their  presence  nevertheless  provides  supportive  evidence  for  the 
linearity,  and  Invariant  properties  of  the  allocation  mechanism,  and  en- 
courages further  investigation. 

Optimality  of  the  Allocation  System.  The  coherence  analysis  performed 
indicated  clearly  that  subjects  did  not  behave  as  the  optimum  allocator  of 
Figure  1.  In  marked  contrast  to  the  instructions  delivered  to  the  subjects, 
primary  task  performance  was  highly  sensitive  to  primary  task  difficulty* 

It  is  therefore  important  to  ask  why,  in  the  present  results,  subjects  ap- 
peared unable  to  follow  the  imposed  priority  instructions.  Wickens  and 
Kessel  (Reference  6)  showed  that  when  the  difficulty  of  a task  (instability 
tracking)  is  increased  between  sessions  in  a dual  task  environment,  it  is 
possible  for  subjects  to  hold  that  task  performance  constant--at  the  ex- 
pense of  secondary  task  performance.  Why  then,  when  difficulty  was  manipu- 
lated within  a session  in  the  current  experiment,  was  the  severe  limitation 
observed? 

It  appears  unlikely  that  subjects  simply  ignored  the  instructions,  as 
resources  clearly  were  withdrawn  from  the  secondary  task  to  deal  with  the 
difficulty  increase  and  were  returned  when  demands  were  lowered,  thus  pro- 
ducing the  high  secondary  task  coherence  measure.  Instead  it  appeared  that 
either  the  resources  withdrawn  were  not  delivered  to  the  primary  task,  or 
alternatively  that  the  changes  in  difficulty  were  sufficiently  abrupt  that 
smooth  resource  modulation  could  not  occur  (l.e.,  resource  adjustment  did  not 
have  sufficient  time  to  operate).  This  second  hypothesis  is  supported  by 
visual  inspection  of  Figure  3.  Note  following  the  difficulty  step  increases 
at  times  t • 24-28  and  t » 96  seconds  that  in  both  instances  primary  task 
error  begins  gradually  to  reduce  as  secondary  task  error  undergoes  a corres- 
ponding increase,  as  If  at  this  point  the  subject  begins  a gradual  and  ap- 
propriate reallocation  of  processing  resources  away  from  the  secondary  task 
toward  the  primary,  in  accordance  with  instructions.  In  fact  a rough  esti- 
mate of  the  lag  between  difficulty  increases  and  secondary  task  error  in- 
creases places  this  lag  at  approximately  2-3  seconds,  a value  that  corres- 
ponds reasonably  well  to  the  2.8  second  lag  observed  by  Delp  and  Crossman. 


The  implication  of  this  observation  is  that  the  appropriate  resource  mobil> 
ization  might  be  within  the  capabilities  of  the  operator  to  a greater  extent, 
had  the  difficulty  transitions  been  of  the  mote  gradual  nature  employed  by 
Delp  and  Crossman. 

Feedback.  The  contrast  in  performance  measures  between  the  augmented 
feedback  and  no* feedback  conditions  indicated  further  that  the  operator's 
limits  were  manifest  in  the  second  stage  of  the  closed  loop  allocation  sys* 
tem**the  reallocation  of  resources**rather  than  in  the  first  stage**the  er* 
ror  evaluation  process.  When  this  evaluation  process  was  presumably  aided  by 
explicit  presentation  of  the  discrepancy  between  desired  and  obtained  per- 
formance, no  reliable  improvement  in  allocation  behavior  was  observed,  either 
in  the  form  of  a reduction  of  primary  task  error,  or  a reduction  in  its  lin- 
ear coherence  function  with  alpha.  In  fact,  the  only  effect  of  feedback 
that  was  observed  was  a reliable  Increase  in  secondary  task  error,  and  a 
corresponding  increase  in  the  secondary  task  coherence  measure,  as  this 
task  apparently  became  more  responsive  to  the  changes  in  primary  task  dif- 
ficulty. 

While  augmented  feedback  did  not  prove  to  be  useful  in  the  current 
investigation,  the  conclusion  drawn  must  of  necessity  be  limited.  It  is 
quite  likely  that  the  difficulty  changes  were  sufficiently  dramatic  that 
their  presence,  and  the  resulting  performance  changes,  were  easily  observa- 
ble by  the  subjects.  Changes  of  a more  subtle  nature  might  have  produced 
a sub-threshold  deterioration  in  performance  that  could  only  be  detected 
with  the  aid  of  the  augmented  feedback. 


CONCLUSION 


The  major  limitations  of  human  performance  in  the  variable  difficulty 
paradigm,  demonstrated  in  the  present  results,  suggest  that  this  area  war- 
rants further  exploration.  Research  is  needed  to  determine  the  effect  on 
allocation  ability  of  such  variables  as  training,  the  nature  of  the  diffi- 
culty time  functions,  and  the  qualitative  similarity  between  the  time- 
shared  tasks.  Through  this  research  a better  appreciation  can  be  gained 
not' only  of  the  mechanism  by  which  attentional  resources  are  allocated,  but 
of  the  fundamental  nature  of  those  resources  themselves. 
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Abstract 

This  paper  consists  of  two  parts*  The  first  part  describes  the 
problem  of  multi-task  attention  allocation  with  special  reference  to 
aircraft  piloting,  the  experimental  paradigm  we  use  to  characterize 
this  situation  and  the  experimental  results  obtained  in  the  first 
phase  of  our  research.  A qualitative  description  of  an  approach  to 
mathematical  modeling,  and  some  results  obtained  with  it  are  also 
presented  to  Indicate  what  aspects  of  the  model  are  most  promising. 

The  second  part  of  the  paper  consists  of  two  appendices  which  (1)  dis- 
cuss the  model  in  relation  to  graph  theory  and  optimization  and  (2)  speci- 
fy the  optimization  algorithm  of  the  model. 


1.  Introduction 

We  think  that  an  increasingly  crucial  aspect  of  piloting  an  air- 
craft is  '•multi-task  allocation  of  attention”.  The  pilot  must  monitor 
many  more  systems  than  before,  most  of  which  are  growing  in  complexity. 

In  earlier  days  flying  the  aircraft  ”by  the  seat  of  the  pants"  was 
difficult,  but  piloting  was,  more  or  less,  a constant  task.  It  was  ob- 
vious that  the  pilot  could  keep  track  of  what  was  being  controlled  at 
what  time  and  how  well  that  was  working  because  he  was  doing  it;  he  was 
in  the  loop  and  could  see  or  feel  it  directly. 

As  systems  become  automatic  the  pilot  himself  tends  to  lose  track 
of  what  signals  are  coming  into  what  subsystem  and  what  response  that 
subsystem  is  making.  Most  of  the  time  when  everything  is  normal  the 
automatic  systems  do  just  fine*  Indeed  if  we  demanded  tha^t  the  pilot 
actually  perform  all  functions  which  are  now  automated  it  is  clear  he 
couldn't  do  a fraction  of  such  tasks.  Yet  we  expect  him  to  monitor  all 
such  functions,  and  at  the  first  overt  alram  or  even  subtle  evidence  of 
failure  we  expect  him  to  be  able  to  render  a quick  accurate  diagnosis  of 
the  problem  and  set  it  straight. 

We  call  the  pilot  a "flight  manager"  or  "supervisory  controller"  and 
v;e  see  him  in  the  image  of  a corporation  manager  with  legions  of  dutiful 
automatic  servants  doing  his  will  and  bringing  him  information  as  he  de- 
sires it.  The  problem  is  that  the  corporate  manager  has  time  to  ponder 
and  investigate  and  weigh  evidence  and  consider  his  decisions*  He  operates 
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on  a human  time  scale:  if  the  corporation  manager  sees  his  "production 

vehicle"  about  to  go  bankrupt  he  has  at  least  a few  minutes  to  decide 
what*s  wrong  and  what  to  do  about  it.  The  flight  manager  doesn^t. 

The  general  research  questions  implied  are: 

a)  What  are  the  expected  behaviors  and  what  are  the  limits  of  a 
personas  capability  to  allocate  his  attention  among  many  simul- 
taneous tasks  of  varying  importance  and  varying  urgency,  as  a 
function  of  the  number  of  tasks,  the  general  pace  at  which  they 
occur  and  other  salient  parameters? 

b)  If  there  is  a nonnative  or  optimal  way  a person  should  perform 
such  a task,  can  it  be  specified  as  a quantitative  model,  and 
how  close  does  a trained  person  come  to  behaving  optimally? 

c)  What  are  the  implications  for  Improving  the  design  of  the  man- 
machine  systems  in  which  the  pilot  must  perform  such  multi-task 
allocation  decisions? 


2#  Experimental  Paradigm 

To  characterize  such  a multi-task  decision-making  situation  we  have 
developed  a very  general  experimental  paradigm  and  an  associated  model.  The 
experimental  paradigm  requires  the  subject  (or  decision-maker  DM)  to  select 
one  at  a time  from  among  a number  of  blocks  ("tasks")  of  different  heights 
and  widths  displayed  simultaneously  on  a CRT  (Figure  1) • His  selection, 
made  by  holding  a cursor  even  with  the  block  "attended  to"  is  in  order  to 
maximize  his  reward,  where  the  earning  rate  is  proportional  to  the  displayed 
"importance"  (indicated  by  the  height  of  each  block)  and  the  "productivity 
rate"  (the  rate  at  which  the  block  decreases  in  width  when  "attended  to"). 
Blocks  appear  at  random  distances  from  a "deadline"  and  move  at  constant 
velocity  toward  that  deadline,  disappearing  when  they  first  touch  it.  Var- 
ious task  parameters  have  to  do  with  the  frequency  at  which  new  blocks  ap- 
pear, the  speed  with  which  they  move  toward  the  deadline,  the  variability 
in  importance,  the  variability  in  how  far  from  the  deadline  they  first  appear, 
and  so  on.  The  toal  is  to  "remove"  as  much  block  area  as  possible. 

In  one  experiment  blocks  continually  appear  with  exponential  dis- 
tribution in  time.  In  a second  experiment  all  blocks  appqar  at  the  start 
of  the  run;  no  new  ones  appear  thereafter. 

An  Important  feature  of  the  experiment  is  that  blocks  do  not  queue 
up  for  service,  i.e.,  if  a block  reaches  the  deadline  the  opportunity  to 
earn  its  reward  is  lost.  We  cannot  say  for  sure,  however,  whether  blocks 
queue  in  the  operator’s  mind  for  attention  in  correspondence  to  the  fact 
that  at  any  one  instant  of  time  there  may  be  some  blocks  which  are  far  from 
the  deadline  and  others  which  are  close.  The  close  ones,  of  course,  may  be 
of  little  importance,  so  often  It  is  better  to  attend  to  more  important 
tasks  which  are  farther  from  the  deadline  in  order  to  ensure  that. all  of 
the  really  important  ones  do  get  attended  to  before  the  deadline. 
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Figure  I.  Experimental  Computer  Display  of  Moving  Blocks  Representing  Tasks 


Figure  2.  Record  of  D.M. 
Trajectory  in  Real  Time 


s Action 
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Figure  2. Illustrates  a means  we  have  used  to  obtain  a time-plot 
of  which  block  the  subject  selects  in  which  queue  (column  headings) « 
Printed  symbols  in  each  column  tell  the  service  time  the  block  requires t 
the  time  the  block  will  be  available,  and  the  value  to  be  obtained. 

Having  Informally  experimented  with  this  situation  with  a variety 
of  parameter  combinations  we  are  now  in  a position  to  claim  that  the 
experiment  does  seem  to  simulate  various  attentional  demands  which  are 
placed  on  the  pilot.  These  vary  considerably  in  duration.  Some  tasks 
are  urgent,  but  of  modest  importance;  some  are  urgent  and  of  great  impor- 
tance; some  are  not  urgent  and  of  modest  Importance;  some  are  not  urgent 
but  of  great  importance  to  be  done  before  the  deadline. 


3.  Experimental  Results 

As  the  first  phase  of  the  second  author's  doctoral  thesis,  experi- 
ments with  human  subjects  have  been  run  with  various  experimental  para- 
meter combinations.  Because  the  number  of  such  possible  combinations  is 
so  large  we  have  Investigated  the  effects  of  changing  one  parameter  at  a 
time,  relative  to  a "baseline  condition".  Table  1 indicates  that  for  all 
runs  the  subject  worked  with  3 queues  of  blocks  (tasks)  and  runs  lasted 
400  seconds.  The  baseline  parameters  are  given  above.  Seven  changes  in 
parameters  are  indicated  below,  made  one  run  at  a time,  all  other  parameters 
matching  the  baseline  condition  in  each  case.  For  each  the  values  gained 
by  each  of  three  subjects,  the  range  of  their  data,  the  average,  and  the 
total  possible  are  given. 

In  Table  1 it  is  seen  that  a considerably  higher  speed  of  blocks 
moving  toward  the  deadline  (2)  reduces  the  score,  but  not  much,  compared 
to  the  baseline  (1) . Greater  variation  in  block  speed  (3)  makes  little 
difference.  A reduction  of  interarrival  time  (4)  of  blocks  means  more 
blocks  become  available  - more  opporunity  is  there  for  earning  a score  - 
but  a smaller  fraction  of  these  are  completed.  As  the  height  of  blocks 
(task  value  densities)  become  more  variable  (5)  the  net  earnings  are 
little  affected,  though  the  presence  of  a few  very  lucrative  blocks  doubles 
the  total  possible  score.  Giving  partial  credit  (6)  for  productivity 
(allocation)  on  a task  when  it  hits  the  deadline  Increases  the  earnings 
little  more  than  one  percent,  which  is  surprising.  Lowering  productivity 
(7)  has  the  most  significant  effect,  as  seems  intuitively  reasonable  - but 
the  reduction  in  score  is  not  quite  in  proportion  to  the  forced  reduction 
in  rate  of  doing  tasks. 


4.  A Mathematical  Modeling  Approach 

To  accompany  the  experimental  task,  we  have  developed  a mathematical 
model  which  can  be  run  on  the  computer  immediately  after  any  human  data  run. 
(Tie  relationship  of  the  model  to  graph  theory  in  general  and  the  full  speci- 
fication of  the  model  algorithm  given  in  Appendices  1 and  2 respectively). 
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COMMON  CONDITIONS 

3 queues,  400  sec  duration 

BASELINE  CONDITION 

Task  Interrival  time,  exponential  distribution,  mean  “ 20  sec/queue 

all  tasks  appear  5 units  away  from  the  deadline 

all  tasks  2,5  units  in  duration 

all  tasks  speed  toward  deadline  at  0.1  units/sec. 

productivity  on  all  tasks  0.5  units  per  sec. 

value  density  rectangular  distributor  0-1  utiles/sec 

No  partial  credit  was  given  in  the  baseline  case. 

CONDITION 

% AVAILABLE  VALUE  GAINED  BY  SUBJECTS  AVG. 

DY  KT  SJ  RANGE 

TOTAL  POSSIBLE 
VALUE  (UTILES) 

.913 

.931 

.942 

.029 

.929 

98.7 

2 More  speed 

(2.5  B) 

.917 

.880 

.878 

.061 

.891 

98.7 

3 Variable  speed 

(rect,  .05-2.5) 

.934 

.907 

.912 

.027 

.918 

98.7 

4 Less  Interarrlv 

time  (0.75B) 

al 

.803 

.809 

.795 

.014 

,802 

122.2 

5 More  varied 

value  density 
(rect  dist  0-2) 

.946 

.044 

.929 

197.6 

6 Baseline,  but 

with  partial 
credit 

.943 

.949 

.926 

.023 

.940 

98.7 

7 Less  produc- 

tivity (0.5B) 

.642 

.660 

.650 

.018 

.650 

98.7 

Table  I 


Some  Experimental  Results 
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The  model  is  essentially  a dynamic  program  which  calculates  an  optimal 
"attention  allocation  trajectory"  for  all  the  blocks  present,  and  then  takes 
the  first  step  of  that  trajectory.  As  soon  as  each  new  block  appears,  the 
dynamic  programming  calculation  is  repeated.  The  model  is  constrained  by 
three  parameters  to  make  it  human-like.  The  parameters  may  be  adjusted 
according  to  various  criteria  until  the  model  best  fits  experimental  data. 
One  parameter  is  a time  delay  T,  simply  a^.justed  to  match  human  motor  reac- 
tion time  plus  decision  time. 

A second  parameter  is  a linear  discounting  of  Importance  of  later 
blocks  in  various  alternative  trajectories  which  the  dynamic  programming 
algorithm  compares  to  determine  which  trajectory  costs  least.  This  dis- 
count rate  ue  call  3*  Zero  B means  that,  in  present  evaluation  of  alter- 
native trajectories  for  future  action,  what  the  model  earns  in  the  more 
distant  future  weights  just  as  heavily  as  what  it  earns  in  the  very  next 
step.  Large  B means  the  model  discounts  the  future  completely  and  only 
considers  alternative  next  steps. 

A third  parameter,  y*  ^ linear  discount  rate  on  distance  of  blocks 
(tasks)  from  the  deadline,  determined  anew  at  each  successive  model 
iteration.  Zero  y means  that,  in  deciding  what  to  do  next,  blocks  far 
from  the  deadline  are  just  as  heavily  weighted  as  those  close  to  it 
(multiplied  by  the  blocks*  individual  importance).  Large  y means  the 
model  only  attends  to  what  is  close  to  the  deadline.  It  is  a "putting 
out  bonfires"  strategy. 

It  may  seem  at  first  reading  that  B and  y mean  the  same  thing,  but 
this  is  not  true,  and  in  fact  it  was  our  experiments  which  led  us  to  see 
this  distinction:  this  aspect  of  the  model  grew  out  of  the  research.  The 

point  is  that  time  into  the  future,  with  respect  to  alternative  sequences 
of  (planned)  action,  is  quite  different  from  opportunity  time  available. 

In  other  words,  the  task  which  is  far  from  the  deadline  can  be  done  first, 
and  the  one  which  is  close  to  the  deadline  done  later.  The  only  absolute 
constraint,  of  course,  is  that  no  task  can  be  "done"  after  it  crosses  the 
deadline. 


5,  Results  from  the  Model 

We  now  have  experimented  with  the  model  itself  on  various  multi-task 
situations.  In  those  situations  cited  above  where  all  blocks  appear  at 
the  outset  we  have  verified,  as  expected,  that  zero  B and  zero  y are  best. 
All  information  is  known  from  the  start,  and  an  optimal  trajectory  as  de- 
termined by  dynamic  programming  is  optimal  in  an  absolute  sense. 

Curiously,  this  is  not  true  of  the  experiment  where  blocks  appear 
continually.  Let  us  recall  that  the  dynamic  prograumting  algorithm  com- 
putes an  optimal  trajectory  based  on  what  blocks  are  in  view  at  the  time, 
then  commits  Itself  to  the  first  step  of  that  opMmal  trajectory.  Thus, 
if  there  is  discounting  in  "planning  time",  optimal  may  be  to  do  a rela- 
tively unimportant  but  about-to-dlsappear  task,  since  there  is  just  time 
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to  oomplete  ah  import^int  task  which  Is  the  ohX/  one  available;  But« 
^lle  doing  the  unimpOriaht  task*  suppose  a new  important  task  appears 
tdth  the  same  opportunity  time  lis  the  other  toportant  one.  A choice  must 
be/niade  between  the  two  impoefattt  tasks*  .since  only^one  task' catr'be^ 
attended'^to  at  a t^me|  one  important  task  roust, be  lest.  Had  the  model 
expected  the  new  important  task  was  ccroiing  it  irould  have  attended  first 
to  the  avallab^le  important  task*-  ignoring,  the  unimportant  olose-to-dead- 
line  one*  and  then  had  time  availabre  for  the  new  important  one.  In- 
stances of  this  effect  are  revealed  in  simulation  runs  described  below. 


Our  model  runs  thus  far  had  been  made  with  varying  T values  (reac- 
tion times)  and  either  varying  0 or  varying  Y«  t values  have  been 
matched  to  average  reaction  times  of  experimental  subjects  on  a one- 
run-at-a-time  basis. 


We  have  let  the  con^uter  compare  human  DM  results  with  computer 
results  separately  on  the  basis  of  five  different  criteria:  1)  per- 

cent value  gained  for  the  given  run  out  of  the  total  possible  value 
obtainable;  2)  percentage  of  all  completed  tasks  Independent  of  duration 
or  importance;  3)  percentage  of  time  both  model  and  human  subject  acted 
on  the  same  tasks  at  the  same  time;  4)  squared  differences  between  cumu- 
lative value  gained  by  model  and  human*  suimned  over  the  entire  run; 

5)  squared  differences  between  Incremental  value  gained  by  model  and 
human  for  brief  time  interval*  summed  over  the  entire  run* 

Figures  3 through  7 show  examples  of  five  model  runs.  Figure  3 is 
for  subject  KT  for  the  baseline  experimental  conditions.  Figure  4 is 
for  the  same  subject  for  a speed  2.5  times  as  great  as  the  baseline. 

Figures  5*  6*  and  7 are  for  three  different  subjects  for  a productivity 
half  that  of  the  baseline.  On  each  page  are  ten  plots*  each  plot  repre- 
senting a series  of  model  runs  at  different  values  of  0 (left  column*  see 
abscissa  below  for  value  of  0)  with  y ■>  0*  or  model  runs  at  different 
values  of  y (right  column)  with  0 • 0*  Points  syrobolired  by  X are  model 
runs.  The  horizontal  lines  represent  human  data  for  the  given  experimental 
condition.  Circles  are  comparisons  between  human  and  model.  Each  row  is 
for  measures  according  to  a different  criterion*  as  indicated.  Thus  all 
points  on  any  vertical  slice  represent  the  same  model  run.  Ordinate 
values  of  the  performance  criteria  are  shown  at  the  right* 

Thus*  considering  the  plots  in  order  from  top  criterion  to  bottom* 
the  top  one  is  to  be  maximised  (or  matched  to  the  line  for  best  fit  to 
human).  The  X plot  of  the  second  one  is  to  be  maximised  (or  matched  to 
the  line  for  best  fit  to  human);  the  circles  on  this  plot  represent  X 
of  tasks  which  are  common  to  model  and  human*  and  are  to  be  maximised. 

The  third  plot  is  to  be  maximised*  the  fourth  and  fifth  are  to  be  minimised. 


For  the  first  criterion  (Z  value  gained)  It  is  evident  that  the 
model  closely  approxliuates  the  human*  at  lower  values  of  0 or  Y dolnt 
slightly  better  (as  one  would  expect  for  little  or  no  discount!  while 
at  higher  values  doing  slightly  worse  (where  the  model  is  not  allowed 
to  **plan  ahead'**  i.e**  0 is  large*  or  ie  not  allowed  to  coneider  blocks 
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Figure  5.  Condition  7 
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Figure  6.  Condition  7. 
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Figure  7*  Condition  7. 

interarrival  20  sec/queue 
speed  0.1  units /sec 

productivity  0.25  units/sec 
Subject:  SJ 


far  from  the  deadline,  i,e.,  y is  large).  Interestingly,  however,  for 
data  on  the  first  two  pages  zero  8 is  not  quite  as  good  as  a slightly 
larger  0.  The  theoretical  reason  for  this  was  discussed  above,  i.e,, 
with  a slight  discounting  of  the  future  the  model  is  more  apt  to  do  the 
most  important  block  first,  and  be  more  open  to  new  blocks  which  have 
high  payoff. 

In  everyday  terms,  this  suggests  that  a person  with  lots  to  do, 
little  time  to  do  it,  and  new  tasks  continually  popping  up  with  rela- 
tively short  deadlines,  should  not  plan  too  far  ahead.  Mostly  he  should 
do  the  most  important  thing  first,  ignoring  the  closest-to-deadline 
factor.  As  he  has  time  to  see  what's  coming  farther  into  the  future 
and  doesn't  expect  many  new  opportunities  to  be  popping  up,  he  should 
plan  ahead.' 

With  respect  to  the  second  criterion  (%  tasks  completed)  it  is 
Interesting  that  the  model  and  human  match  precisely  in  a mid  range 
of  8 which  is  also  the  best  match  of  model  to  human  for  tasks  which 
are  common  to  both  model  and  human.  This  suggests  (1)  that  a 8 in 
this  range  is  a good  candidate  for  a model,  (2)  that  the  higher  task 
completion  capability  of  the  model  in  other  8 ranges,  without  con- 
commltant  Increase  in  total  value  gained,  meant  it  was  wasting  time 
on  unimportant  tasks.  The  y fits  for  this  criterion  are  not  so  good 
or  so  consistent,  and  we  begin  to  see  that  y seems  not  to  be  a very 
meaingful  parameter. 

As  for  the  next  parameter,  % of  time  acting  on  the  same  task  at 
the  same  time,  it  appears  that  the  8 curve  peaks  at  approximately  the 
same  value  for  several  of  the  subjects,  but  again  the  y curve  is  not 
very  interesting. 

The  curves  for  the  final  two  criteria  seem  to  have  little  to  offer, 
except  that  the  fourth  curve  consistently  takes  a jump  (gets  worse)  for 
8 values  at  0.1  or  larger. 

Further  experiments  will  seek  to  refine  the  model,  the  fitting 
criteria,  and  possibly  add  an  estimator  of  future  tasks  to  the  op- 
timization algorithm. 
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Appendix  1.  The  Model  In  Relation  to  Graph  Theory 

The  paradigm  described  In  the  paper  will  result  In  a graph  0^(1)  * 
G(N;A)  with  N nodes  and  A arcs,  where  each  node  represents  a task  and 
arcs  represent  the  transfer  properties  between  these  tasks.  Note  that 
rewards  associated  with  different  nodes  can  be  different  and  delay“(time-) 
dependent.  Also  the  processing  (or  service)  and  availability  times  of 
the  nodes  and  the  transfer  times  between  them  can  be  different.  There- 
fore In  a reward-time  (r-t)  coordinate  framework  we  have  graph  G (t)  as 
shown  In  Figure  Al. 

Note  that  In  Figure  Al  T values  represent  transfer  times  between 
nodes,  which  Incidentally  can  be  direction-dependent,  such  that  precedence 
constraints  can  be  Imposed,  t^,  t®  and  t^  are  "ready-time",  "deadline  time" 
and  '-’processing  time",  respectively.  Note  that  when  the  rewards  associated 
with  the  tasks  are  constant  until  they  hit  the  deadline,  the  r-t  curve 
associated  with  a node  will  be  as  shovm  In  Flgure-A2a.  For  the  case  in 
which  the  DM  can  get  partial  credit,  however,  the  rewards,  rather  than 
being  Fixed-Loss,  will  be  as  shown  in  Figure-A2b. 

o 

In  the  Figure  A2  t is  the  slack  time,  i.e.  the  latest  time;  if, 
during  which  the  task  is  completed  all  the  reward  associated  with  the 
task  can  be  gained*  Note  that  "time  available"  is  deadline- time  minus 
ready-time:  . 


One  interesting  observation  that  can  be  made  from  Figure-Al  is  that 
in  Gf(t)  graphs  there  may  not  be  enough  time  to  get  the  rewards  of  all 
nodes  N*  In  fact,  we  can  infer  from  the  same  figure  that  the  best 
schedule  that  can  be  chosen  in  the  particular  graph  Gx(t)  is  II  * (2,1,4) 
which  does  not  include  node  (task)  3* 

At  this  point  we  digress  and  consider  this  sequencing  problem  in 
relation  to  other  common  combinatorial  problems  like  vTob-Shop  Scheduling, 
Traveling  Salesperson,  etc.  (Golden  and  Magnanti,  1977). 

We  can  differentiate  the  sequencing  problems  listed  in  Table-Al 
according  to  the  following  criteria: 

1)  Will  multiple  journeys  between  the  nodes  be  counted  multiple? 

2)  Can  we  add  extra  nodes? 

3)  Can  the  rewards  associated  with  the  nodes  be  delay-dependent? 

4)  Can  the  transfer  delays  between  different  pairs  of, nodes  be 
different? 

5)  Is  it  imperative  to  return  to  the  base  node? 

6)  Is  it  necessary  to  satisfy  the  above  requirement  before  a 
certain  delay,  T]^? 

7)  Gan  the  graph  G,  desribing  the  problem  change  dynamically  in  time? 

See  list  of  symbols  at  end  of  Appendix  2. 
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FIGURE  Al.  A Schedule  IT  = (2,1,4)  for  Multi-Task  Attention 
Allocation  on  Graph  G^(t)  = G ( N ; A ). 


FIGURE  A2  Reward-Time  Curves  for  a Task  (a)  when  no  Partial 

Credit  is  Given,  and  (b)  when  Partial  Credit  is  Given. 


Using  these  criteria  we  have  listed  some  common  combinatorial  optimiza- 
tion problems  with  two  new  ones; 

a)  Minimum  Spanning  Trees,  MST  (Kruskal,  1956) 

b)  Steiner  Tree  Problem,  STP  (Nijenhuls  & Will,  1975) 

c)  Job-Shop  Scheduling,  JSS  (Elmaghraby,  1968  and  Sahni,  1976) 

d)  Hamilton  Cycle,  HC;  alias  the  Traveling  Salesperson  Problem 
(Held  & Karp,  1962) 

e)  Open  Tulga-Path,  OPT;  alias  Multi-Task  Attention  Allocation, 

f)  Closed  Tulga-Path,  CTP 

Note  that  Irf  Table-Al  the  indicator  '0*  means  that  the  particular  cri- 
terion need  not  be  satisfied  for  the  problem  at  hand,  while  indicator  *1* 
is  for  the  opposite  case,  with  ’N/A’  indicating  that  the  criterion  is  not 
applicable  for  the  problem.  Figure-A3  is  a schematic  representation  of 
some  of  the  problems.  OTP  describes  Multi-Task  Attention  Allocation. 


Problems  vs. 


Criteria; 

MST 

STP 

JSS 

HC 

OTP 

CTP 

1 

0 

0 

1 

1 

1 

1 

2 

0 

1 

N/A 

N/A 

N/A 

N/A 

3 

0 

0 

1 

0 

1 

1 

4 

1 

1 

0 

1 

1 

1 

5 

0 

P 

0 

1 

0 

1 

6 

0 

0 

0 

0 

0 

1 

7 

0 

0 

0 

0 

1 

1 

Table-Al. 

Properties 

of  Various  Sequencing  Problems 

Before  returning  to  the  Multi-Task  Supervisory  Control,  the  reader 
can  observe  from  Flgure-A3  that,  if  the  requirement  was  to  serve  all  the 
nodes  (tasks)  with  minimum  number  of  controllers  (or  processors  or  vehi- 
cles or  people,  etc.)  another  controller  might  have  been  assigned  to 
node-3  in  Flgure-A3(ili) , and  the  OTP  problem  will  become  an  advanced 
version  of  the  ’Bin-Packing  Problem’.  (Johnson,  1974)  The  reader  may 
note  here  the  case  of  computer  aiding  (2nd.  controller)  of  the  human 
operator  (1st.  controller).  (Rouse,  1977)  Similarly  in  Flgure-A3(iv)  an 
extra  vehicle  can  serve  node-3  and  come  back  to  the  base  node  before 
Tgj  however,  unless  the  return  time  Tg  is  sufficiently  large,  node-4 
cannot  be  served  whatever  the  number  of  vehicles,  but  as  Tg  increases 
3,  then  2 vehicles  will  be  enough  to  serve  all  the  nodes:  the  CTP  then 

becomes  an  advanced  ’Vehicle-Routing  Problem".  (Golden,  1976) 

We  can  see  from  Figure-A3  that  Multi-Task  Attention  Allocation 
Paradigm  is  representable  by  the  OTP  Combinatorial  Problem  when  we  con- 
sider chat  node  0 (base  node)  is  where  the  DM  currently  is,  and  4 tasks 


584 


FIGURE  A3  Graphical  Representation  of  Some  Sequencing  Problems 


FIGURE  A4.  The  Return^ for  a Task^as  a Function  of  Time  for  the  Partial 
Credit  Mode 


585 


are  (or  will  be)  available  with  different  properties.  The  DM  will  then 
act  on  the  first  task  of  the  optimal  schedule,  11°  - (2,1,4),  i.e.  task  2. 

Note  however,  that  nex»  tasks  may  appear  on  this  graph  Gf(t.)  probabi- 
listically according  to  the  interarrival  rates  and  with  the  task  para- 
meters explained  in  the  paradigm  section,  and  the  thing  to  be  maximized 
is  the  reward  gained  at  the  end  of  the  experiment,  so  that  tasks  Chat  are 
going  to  appear  cannot  be  ignored.  That  is  to  say:  since  graph  GT(t) 

is  time-dependent,  then  the  optimal  schedules  11° (t)  on  them  are  time- 
dependent  too. 


Appendix  2.  Optimization  Algoritlim  of  the  Model 

In  choosing  his  control,  i.e.,  which  cask  to  at  upon,  we  can  model 
the  DM  as  an  optimal  controller  who  maximizes  his  expected  returns  over 
a planning  horizon.  (Koopmans,  1964).  In  particular,  the  DM  will  act 
to  maximize  his  expected  total  returns  over  a finite  planning  horizon, 
T,  with  a discount  function  B(3,  t): 

max.  r(n)  = e[  ] 


where  ^ 

(l,j)ell 

in  which  the  summation  is  over  all  Che  tasks  (l,j),  which  collectively 
make  up  the  ordered  task  set,  schedule  II,  that  the  DM  expects  to  act 
upon  over  his  planning  horizon.  Rij(t)  is  the  return  he  gets  for  acting 
on  (or  completing)  the  task  (l,j)  during  (or  at)  time  t. 

For  the  case  in  which  the  DM  gets  credit  continuously  while  acting 
on  a cask,  the  Rij(t)  will  be  as  shown  in  Figure-A4. 

In  Figure-A4,  tj[4,  Fij»  d^j,  pj^j  represent  the  time  at  which  the 
DM  plans  to  start  acting  on  Che  task,  the  value  density  of  the  task,  Che 
duration  of  the  task,  and  the  productivity  of  the  DM  for  the  Cask  (l,j), 
respectively. 

If  however,  the  DM  is  going  to  get  (full)  credit  only  after  success- 
fully completing  a task,  then  the  Rij(t)  will  be  as  shown  in  Figure-AS. 

The  DMj  in  effect,  will  choose  at  each  decision  point  a schedule 
n°  « (n|,  II2*...)  that  he  Intends  to  act  upon  to  maximize  his  expected 
returns,  and  then  he  will  actually  act  upon  the  first  task  }l£,  in  this 
ordered  set  of  tasks. 

It  is  probable  and  acceptable  chat  he  might  have  to  give  up  on 
acting  on -some  tasks  when  their  'available  times'  are  small  - due  to 
their  high  speed  and/or  due  to  their  proximity  to  the  deadline  - or 
when  they  have  comparatively  low  value  densities,  especially  in  compe- 
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FIGURE  A6.  Increasing  Priorities  o£  Different  Tasks  as  They 
Walt  to  be  Served. 
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tltlon  with  other  simultaneously  available  tasks  which  are  preferred  in 
these  respects.  Another  important  parameter,  of  course,  is  the  trans- 
fer time  between  the  queues*  He  has  to  consider  the  fact  that  he 

will  end  up  getting  no  credit  for  a period  of  time  when  he  transfers  his 
control  from  the  i.th  queue  to  the  i'.th  one. 

O 

The  algorithm  for  finding  the  optimal  schedule  of  tasks  II  , to  act 
upon  is: 

Algorithm  T_PATH 

Input  (usage,  B.  G) 

The  input  parameter  'usage*  indxcates  whether  an  OTP  or  a CTP  is 
desired,  and  if  it  is  a CTP,  Tg  is  used  as  the  required  return  time  to 
the  base  node.  T is  the  transfer-delay  time  matrix  between  the  queues 
of  tasks  and  B,  and  G are  discount  functions  on  future  returns  and  on 
tasks  away  from  the  deadline-tasks  with  larger  slack-times  -,  respectively. 

Note  that  the  system  state  tensor  Xijg  specifies  the  various  task 
parameters  for  each  given  Instant  of  time  like: 

1)  whether  the  task  is  available  (display)  or  not,  Ljj  (»1  or  0) 

2)  the  return  associated  with  the  task  as  a function  of  time, 

Rij(t) 

•'  P 

3)  the  processing/service  time  of  the  task  ti-t(t) 

A ■* 

4)  the  'available  time'  of  the  task,  tij(t) 

Output  optimal  schedule  II**,  and  discounted  present  value  r(n**)  and 
completion  time  c(II°)  associated  with  it, 

Stcp-1  [initialize] 

for  i «■  1 to  I do 
for  j ■ 1 to  Jjdo 

while  Ljj  ■ 1 do  /*  is  the  task  available  ? */ 
transform  (i,j)  to  A and 
generate  the  tuple  (r(A),  c(A)) 

r(A)  - Rjj^(t  » 0) 

c<^)  • + tj(t  « 0) 

end 

end 

CO 

Note  that  Rji(t)  ■ / Rj^4(e0,  B(6, 

Furthermore,  the  tasks  currently  available  are  summed  to  give  N,  which 
is  also  the  maximum  number  of  stages,  M,  the  optimal  schedule  can  have. 
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step-2  [Generate  schedules  that  are  m stages  deep]  ORIGINAL  PAGE  IS 

OF  POOR  QUALITY 

for  m ■ 2 to  M do 

generate  ail  m-member-subsets  =*  S 

and  for  each  task  ileS 

generate  the  (r(H)  » c(Il))  tuple(s) 

-where  II  =*{11*  y Hj,  l.e.  schedule  II  is  schedule  11' 

with  task  £ at  stage  n.  . 

-for  each  order{s-£^,  l,e.  for  each  H’  = {s-£j, 

-where  the  '=*  operator  tests  whether  each  member  of  one 
set  is  also  contained  in  the  other.  (Weinberg,  1971) 

r^K)  - r(n')  + R^(t  - c(n’)) 
c(n)  » c(ii')  + + tj(t  - c(n')) 

where  £',  is  the  last  task  - task  at  stage  (m-1)  in  schedule  II'. 


Eliminate  schedules  according  to  the  rules: 


1) 


2) 


Eliminate  the  tuples  which  are  Infeasible,  that  is  credit 
cannot  be  obtained  from  the  last  task  £ in  schedule  II 
before  it  reaches  the  deadline!  or  if  usage  is  CTF,  before 
(Tr  ~ where  Is  the  transfer  time  between  the 

queue  of  task  £ and  the  base  node  0. 


1 2 

Eliminate  schedule  II  , if  there  is  a schedule  II  , such  that: 


and 

-£s  are  the 
schedules- 
and  r(II^)^ 

and  c(n^)^ 


12  1 2 
£ s £ or  queue  of  £ " queue  of  £ 

last  tasks  -at  stage  m-  in  the  respective 

c(n^) 


3)  Eliminate  the  schedules  that  are  less  than  (m-1)  stages 
deep. 


end 


Step-3  [Return  to  the  base  node  if  usage  is  CTP] 


if  usage  ■ Closed  Tulga-Path  Chen 

for  all  schedules  II  do 

r(n)  - r(n)  + R^(t  - c(ID) 

C(ll)  » c(Il)  + 

with  £ being  the  last  task  of  schedule  II • 

end 
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Stcp-4  [optimal] 


The  optimal  schedule  is  the  one  with  the  property: 
r(n”)  > r(II)  for  all  n i r. 

and  if 

r(r>  - r(n)  then  c(r>  < c(n) 


Note  that  when  the  rewards  of  nodes  are  delay-independent  then  this 
algorithm  reduces  to  the  dynamic  programning  formulation  of  the  Traveling 
Salesperson: Problem.  (Held  & Karp,  1962).  On  the  other  hand,  when  trans- 
fer delays  between  all  tasks  are  equal  and  when  rewards  of  all  tasks  are 
Fixed-Loss,  i.e.  constant  up  to  a certain  delay  (time)  and  then  zero,  then 
the  solution  will  reduce  to  Job-Shop  Scheduling  with  Deadlines.  (Elmaghraby, 
1968  and  Sahni,  1976). 

Several  things  should  be  clarified  at  this  point.  First,  if  the  model 
is  permitted  to  get  partial  credit,  as  in  Figure-A4,  then  the  tasks  which 
will  hit  the  deadline  before  they  can  be  complted  will  also  be  included 
in  the  optimization,  although  with  their  returns  kijCl)  appropriately  ad- 
justed to  reflect  the  gain  that  can  be  obtained  from  them  before  they 
disappear. 

Another  point  that  should  be  emphasized  Is  that,  since  all  the  dynam- 
ics of  the  tasks  are  known  a-priori  by  the  algorithm  (and  also  by  the  human), 
there  is  no  need  to  repeat  the  optimization  unless  there  is  a new  task 
arrival;  when  no  new  information  is  presented,  the  optimal  plan,  i.e.,  the 
currently  optimal  schedule  will  be  followed  in  real  time  as  the  tasks  in 
this  linked  list  are  completed.  It  has  also  been  proven  theoretically 
(McNaughton,  19S9)  that  there  is  nothing  to  be  gained  by  shifting  attention 
from  one  task  to  another  and  back  again,  even  in  the  case  of  no  time 
penalti.es  for  doing  so.  On  the  other  hand,  if  after  a new  task  arrival 
the  first  task  in  the  new  optimal  schedule  is  not  the  task  that  is  currently 
being  attended,  then  the  model  will  pre-emptively  leave  the  current  task  to 
serve  the  first  task  in  the  new  optimal  schedule.  However,  the  task  thet  was 
pre-emtively  abandoned  might  still  be  in  the  new  schedule,  and  conditions 
permitting  may  eventually  be  re-attended. 

The  effect  of  C(y*  t®)  will  be  to  adjust  the  return  Rij(t)  for  acting 
on  task  (l,j),  by  changing  the  effective  value  density  of  the  task  (i,j) 
as: 

Rlj(t)  . «y(O.0(T.  tj 

where  tf.  is  the  slack-time  of  the  task,  i.e.,  t®  • max  o{0,t(x/;)-(d/p)]}, 
with  x,x,d,p  representing  the  current  position,  speed,  current  duration 
and  the  productivity  associated  with  tlie  particular  task,  respectively. 
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Kote  that  the  Idea  of  weighing  tasks  according  to  their  initial 
priorities  plus  incremental  priority  increases  as  they  wait  in  a queue 
(Carbonell,  1966  and  Jackson,  1965),  as  shown  in  Figure-A6,  corresponds 
to  the  G(y,  t^)  function,  where  the  initial  priority  is  determined  by  the 
initial  proximity  of  the  task  to  the  deadline,  and  this  priority  in- 
creases as  the  task  approaches  the  deadline. 

It  is  Interesting  to  note  also  that,  as  the  speeds  of.  the  task& 
approach  zero,  i.e.,  the  deadlines  are  at  Infinite  future  time  - and 
if  the  transfer  times  between  all  the  tasks  are  equal,  then  the  DM  is 
modeled  to  choose  the  new  task  to  act  upon,  according  to: 


max. 

(i.j) 


This,  of  course  is  the  familiar  result  from  the  Queueing  Theory  (Smith, 
1956)  when  we  consider  the  productivity  of  the  TO!,  p,.,  as  the  service 
rate  and  the  value  density  of  the  task  (i,J)  the  negative  cost 


per  unit  time  delay  c 


IS' 


iS 


min.  c. .M,.  where  c.  < 0 

(i.j)  *■* 


List  of  Symbols 


G graph 
t time 

T transfer  time 
T dummy  time 

r reward  available  at  a node  (task) 

R reward  gained  for  a givoii  plan 

n tat  total  discounted  return  of  a schedule 

a sc  »e  u e completion  time  of  a schedule 

that  schedule  which  is  optimal 
Tg  deadline  t.ime  for  return  to  base  node 
T planning  horizon 

B discount  function  on  future  returns 

6 discount  parameter  (rate  in  this  case)  on  icuture  returns 
G urgency  discount  function 

Y urgency  discount  parameter  (rate  in  this  case) 

1 total  number  of  queues 

total  number  of  tasks  in  queue  t» 
i combination  of  i & j for  any  task 

M maximum  number  of  stages  that  optimal  schedule  can  have 
m stage  index 

d duration 
k speed 
p value  density 
p productivity 
X position 
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processing  time 

t ready  time 

deadline  time 
A 

t available  time 

3 

t slack  time 
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SUMMARY 


This  study  investigated  performance  of  air  traffic  controllers  using  a 
Microwave  Landing  System  (MLS),  Eight  professional  radar  air  traffic 
controllers  acted  as  subjects  and  performed  their  normal  duties  within  the 
constraints  of  the  experimental  design  and  simulation.  The  task  involved 
the  control  of  two  simulated  aircraft  targets  per  trial,  in  a 37.0-km  (20- 
n.  mi.)  radius  terminal  area,  by  means  of  conventional  radar  vectoring  and/ 
or  speed  control.  The  goal  was  to  insure  that  the  two  targets  crossed  the 
Missed  Approach  Point  (MAP)  at  the  runway  threshold  exactly  60  sec  apart. 

The  effects  on  controller  performance  of  the  MLS  configuration  under  wind 
and  no-wind  conditions  were  examined. 

The  data  for  mean  separation  time  between  targets  at  the  MAP  and  the 
range  about  that  mean  were  analyzed  by  appropriate  analyses  of  variance. 
Significant  effects  were  found  for  mean  separation  times  as  a result  of  the 
configuration  of  the  MLS  and  for  interaction  between  the  configuration  and 
wind  conditions.  The  analysis  of  variance  for  range  indicated  significantly 
poorer  performance  under  the  wind  condition.  These  findings  are  believed  to 
be  a result  of  certain  perceptual  factors  involved  in  radar  air  traffic 
control  (ATC)  using  the  MLS  with  separation  of  targets  in  time. 


INTRODUCTION 


This  study  was  designed  to  investigate  some  of  the  perceptual  factors 
which  affect  performance  of  air  traffic  controllers  using  an  MLS  to  control 
the  landing  of  aircraft.  The  MLS  is  a new  type  of  landing  guidance  aid  and 
is  still  in  an  experimeaital  phase.  When  fully  operational  its  primary 
purpose  will  be  to  facilitate  the  safe  an  expeditious  flow  of  a new  genera- 
tion of  aircraft  into  airports  with  an  efficiency  that  cannot  be  duplicated 
today.  The  implementation  of  the  MLS  will  require  an  alteration  of  the 
physical  structure  of  airways  and  the  ATC  system. 

A radar  scope  was  simulated  on  a cathode-ray  tube  (CRT)  and  displayed 
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a terminal  area  with  the  MLS.  The  controllers  were  presented  with  several 
air  traffic  situations  and  were  required  to  separate  targets.  The  experi- 
mental goal  was  to  identify  some  of  the  perceptual  factors  involved  in  and 
the  performance  of  controllers  using  the  MLS. 

Although  the  MLS  is  one  of  the  most  recent  developments  in  ATC,  and  as 
such  has  not  been  the  subject  of  lengthy  investigation,  research  in  aeronau- 
tics has  placed  considerable  emphasis  on  developments  in  human  factors 
aspects  of  ATC.  The  literature  contains  numerous  reports  on  topics  such  as 
mental  processes  of  controllers  (1),  workload  (11),  and  the  role  of  automa- 
tion (10).  The  general  picture  of  the  evolution  of  ATC  responsibilities  and 
required  performance  has  also  been  outlined  (8,  9).  By  and  large,  data  on 
basic  human  perceptual  processes  specifically  involved  in  ATC  has  received 
only  scant  attention.  Therefore,  this  study,  in  part,  examined  pertinent 
psychological  literature  on  visual  motion  perception  in  order  to  analyze 
performance  of  controllers  using  the  MLS. 


METHOD 


The  geometric  arrangment  of  the  MLS  as  viewed  on  the  radar  scope  is 
significantly  different  from  conventional  Instrument  Landing  Systems.  Where- 
as current  Instrument  Landing  Systems  employ  a single,  straight  course  to  the 
runway,  the  complex  MLS  in  this  experiment  was  composed  of  five  courses,  both 
straight  and  curved.  In  order  to  evaluate  the  effects  of  this  particular 
configuration  on  controller  perception  and  performance,  a specific  task  was 
developed. 


Subjects 

Eight  professional  air  traffic  controllers  served  as  paid  participants. 
All  had  extensive  experience  in  radar  ATC  either  with  the  military  or  FAA  at 
high  traffic  density  locations. 


Apparatus 

A 25.4-  by  25.4-cm  (10-  by  10-in.)  CRT  display  was  generated  by  an 
Evans  & Sutherland  Line  Drawing  System  interfaced  with  a Digital  Equipment 
Corporation  PDF  11/40  computer.  Figure  1 illustrates  the  simulation  that 
represented  the  ATC  scope  with  the  MLS.  The  scale  of  2.9  km/cm  (4  n.  mi. /in.) 
was  close  to  standard  usage. 

Aircraft  targets  were  represented  by  triangles  measuring  .45  cm  (.18 
in.)  on  each  side.  Each  symbol  was  labeled  by  a single  alphanumeric  tag  for 
use  by  the  controller  in  identifying  and  tracking  targets.  The  targets 
appeared  to  move  in  a manner  not  unlike  those  on  conventional  radar  ATC 
scopes.  Simulated  aircraft  had  several  basic  movement  capabilities:  (a) 
entry  along  an  MLS  route  at  the  periphery  and  complete  tracking  to  the  MAP, 

(b)  automatic  landing  and  exit  from  the  display  at  the  MAP,  (c)  heading 
change  at  a rate  of  3°/sec,  and  (d)  acceleration  at  a rate  of  3.7  km/hr 
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(2  knots)/sec  (equivalent  to  .0003  cm/sec2  on  the  CRT).  Altitude  information 
was  not  required  for  this  experiment. 

The  computer  generated  movement  of  targets  was  controlled  by  the  sub- 
ject. His  verbal  commands  were  transmitted  by  a standard  microphone.  Receiv- 
ing and  acknowledging  these  ATC  instructions  was  the  experimenter  in  the  role 
of  pilot  of  the  simulated  aircraft.  Communication  between  the  controller  and 
experimenter  reflected  standard  ATC  operations  and  phraseology.  Upon 
receipt  of  the  controller's  commands,  the  experimenter  input  the  information 
to  the  POP  11/40  computer  via  a high  speed  interface  device  which  then 
altered  the  flight  dynamics  of  the  simulated  aircraft  accordingly. 


Procedure 

The  task  required  that  the  controller  control  two  targets  per  trial  in 
order  to  achieve  the  desired  goal  of  60-sec  separation  between  targets  at  the 
MAP.  At  the  beginning  of  each  trial  one  target  appeared  at  the  start  of  the 
VIKING  route  at  the  37.0-km  (20-n.  mi.)  hash  mark  at  an  airspeed  of  464  km/hr 
(250  knots).  It  was  followed  approximately  60  sec  later  by  a second  target 
at  the  same  airspeed  which  entered  either  along  the  VIKING  route  or  one  of 
the  other  four  MLS  routes.  Since  the  second  target  traversed  one  of  the  five 
routes  in  following  the  first  target,  there  were  five  different  perceptual 
relationships  between  the  two  targets.  These  will  be  called  path  combinations 
of  target  movement.  For  example,  a target  entering  on  the  VIKING  route 
followed  by  a target  on  the  GEMINI  route  would  be  called  the  VIKING-GEMINI 
(V-G)  path  combination. 

The  controller  was  instructed  to  adjust  the  movement  of  one  or  both 
targets  by  use  of  speed  and/or  directional  control  in  order  to  insure  that 
the  two  targets  crossed  the  MAP  exactly  60  sec  apart.  Each  target  automati- 
cally reduced  its  airspeed  to  167  km/hr  (90  knots)  by  the  time  it  reached  the 
9.3-km  (5-n.  mi.)  fix;  this  was  in  keeping  with  normal  aircraft  operating 
limitations.  The  airspeed  of  167  km/hr  (90  knots)  was  then  maintained  to  the 
MAP.  As  the  controller  perceived  the  continuing  relationship  between  the 
targets,  he  had  to  make  a decision  to  issue  or  not  to  issue  ATC  instructions 
to  change  the  relative  movement  or  position  of  one  or  both  in  order  to  reach 
the  goal  of  60-sec  separation.  The  airspeed  and  heading  of  either  target 
could  be  changed  only  during  the  time  that  target  was  between  the  37.0-km 
(20-n.  mi.)  fix  and  9.3-km  (5-n.  mi.)  fix;  the  controller  had  received 
instructions  that  no  control  was  to  be  applied  to  a target  after  it  had  passed 
the  9.3-km  (5-n.  mi.)  fix.  When  the  second  target  reached  the  MAP  the  trial 
was  at  an  end.  The  actual  separation  in  seconds  was  recorded  by  the  computer 
and  used  as  the  raw  data  for  that  trial.  In  order  to  measure  performance  in 
several  situations,  trials  were  conducted  under  wind  (360°  at  46  km/hr  (25 
knots))  and  no-wind  conditions. 

An  introductory  session  familiarized  the  controller  with  the  general 
nature  of  the  experimental  purposes  and  MLS.  Written  instructions  were 
supplied.  Three  practice  trials  with  no-wind  and  three  with  wind  before  the 
respective  experimental  trials  were  used  for  the  purpose  of  acquainting  the 
controller  with  the  appearance  of  the  MLS  and  movement  dynamics  of  targets. 

At  the  conclusion  of  each  practice  trial,  the  controller  was  told  exactly  how 
much  separation  in  time  existed  between  the  two  targets  as  they  successively 
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crossed  the  MAP.  This  gave  the  controller  an  indication  of  the  spatial  and 
temporal  relationships  between  targets  under  his  control.  This  feedback, 
however,  was  not  given  during  experimental  trials. 


Experimental  Design 

Two  dependent  variables  were  studied:  (a)  the  mean  separation  time 
between  targets  at  the  MAP,  and  (b)  the  average  range  about  that  mean. 

A 5 X 2 X 2 factorial  design  for  repeated  measures  was  used  to  analyze  the 
data.  The  five  path  combinations  served  as  five  levels  of  one  independent 
variable.  Two  wind  conditions  constituted  conditions  of  a second  independent 
variable  and  the  order  of  presentation  of  wind  conditions  was  the  third 
independent  variable.  The  wind  treatment  condition  was  presented  first  to 
one  half  of  the  controllers  and  the  reverse  order  was  administered  to  the 
other  half.  There  were  15  experimental  trials  under  the  no-wind  condition 
and  another  15  under  wind.  The  same  path  combination  was  administered  to 
each  controller  three  times. 


RESULTS  AND  DISCUSSION 


The  mean  of  the  three  separation  times  for  each  controller  was  calcu- 
lated and  constituted  the  data  on  which  the  analysis  of  variance  was  per- 
formed. For  the  purpose  of  noting  the  variability  of  controller  performance, 
a second  analysis  of  variance  was  performed  on  the  range  of  the  separation 
times  per  subject.  Results  of  the  analysis  of  variance  for  means  are  shown 
in  Table  1 and  for  range  in  Table  2.  A summary  of  the  means  and  average 
ranges  for  each  condition  is  presented  in  Table  3 and  Table  4,  respectively. 

The  effect  of  the  order  of  presentation  of  wind  conditions  was  not 
statistically  significant.  Therefore,  for  the  purpose  of  analysis  of  other 
results,  these  data  were  combined. 

The  analysis  of  variance  for  means  showed  a significant  difference 
between  path  combinations  (F  = 3.84;  df  =1,  10;  p<  .05).  This  indicated  that 
controller  performance  in  attaining  60-sec  separation  between  targets  was 
affected  by  the  different  path  combinations.  The  analysis  of  variance  for 
range  did  not  indicate  any  significant  effects  (F  = .98;  df  = 4,  24;  p>  .05) 
due  to  different  path  combinations  (fig.  2). 

The  mean  separation  times  between  targets  under  the  no-wind  condition 
(60.6  sec)  and  under  the  wind  condition  (57.0  sec)  were  close  to  the  60-sec 
target  value,  yet  the  magnitude  of  the  average  range  of  times  about  these 
means  was  quite  large  (fig.  2 and  3).  Under  the  no-wind  condition,  the 
average  range  was  19.6  sec,  and  under  wind,  43.2  sec.  The  analysis  of  vari- 
ance for  range  showed  a statistically  significant  difference  in  controller 
performance  as  a function  of  wind  condition  (F  = 12.42;  df  = 1,  6;  p<.05). 

The  analysis  of  variance  for  means  revealed  no  significant  results  (F  = .48; 
df  * 1,  6;  p>.05).  While  the  overall  mean  separation  time  between  targets 
under  the  no-wind  and  wind  condition  were  not  significantly  different,  the 
average  ranges  about  these  means  were.  Both  the  no-wind  and  wind  mean  times 
indicated  a high  degree  of  accuracy  on  the  average  in  attaining  the  60-sec 
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target  value.  But  the  19.6  and  43.2  sec  ranges  showed  the  accuracy  reflected 
in  the  mean  times  to  be  a result  of  the  high  separation  times  between  targets 
cancelling  out  the  low  separation  times,  especially  under  the  wind  condition. 

These  results  will  be  discussed  from  three  points  of  view:  (a)  the 
perceptual  factors  involved  in  performance  of  controllers  using  the  MLS,  (b) 
controller  performance  using  time  as  a relevant  separation  criterion  rather 
than  distance,  and  (c)  the  implications  of  the  findings  for  future  development 
of  the  ATC  system  with  the  MLS. 

The  controller's  perception  of  the  ATC  situation  constitutes  an  impor- 
tant factor  in  understanding  the  results.  Three  primary  perceptual  factors 
are  considered  to  be  of  importance  in  the  controller's  task  in  this  experi- 
ment: (a)  spatial  separation  of  targets,  (b)  figure-ground  (map  overlay) 

effects,  and  (c)  the  perception  of  wind-generated  accelerated  motipn.  The 
latter  point  appeared  to  be  most  significant  in  evaluating  the  data  and 
requires  special  consideration. 

The  mean  separation  time  under  the  no-wind  condition  was  closer  to  the 
60-sec  target  value  than  under  the  wind  condition.  This  was  due  primarily  to 
the  controller's  difficulty  in  taking  into  account  the  differential  effects 
of  wind  on  ground  speed  as  the  target  changed  heading.  The  difficulty  in 
perceiving  the  onset  of  of  accelerated  motion  had  several  consequences  for 
controller  performance.  First,  the  reduction  of  the  ground  speed  of  a target, 
either  in  the  automatic  speed  reduction  phase  of  the  approach  or  as  a result 
of  the  wind,  altered  the  separation  between  it  and  the  other  target.  Should 
the  velocity  change  have  gone  undetected,  the  result  would  have  been  a new 
amount  of  separation  between  targets  of  which  the  controller  was  completely 
unaware.  Obviously,  a continuous  series  of  such  changes  by  one  or  both 
targets  would  lead  to  inaccurate  and  erratic  performance  such  as  was  evident 
under  the  wind  condition.  Second,  the  perception  of  acceleration  of  one  or 
both  targets  required  an  evaluation  by  the  controller  of  the  actions  neces- 
sary to  maintain  or  change  the  relationship  between  the  targets.  This 
necessitated  the  ability  to  make  an  accurate  prediction  of  the  future 
progress  of  the  target  undergoing  acceleration.  It  has  been  shown  by 
Gottsdanker  (4-6)  and  Gibson  (3)  that  future  target  position  during  constant 
velocity  motion  can  be  predicted  with  considerable  accuracy.  However, 
predicting  target  position  during  accelerated  motion  was  found  to  be  general- 
ly inaccurate  and  appeared  to  be  based  on  the  last  perceived  velocity  rather 
than  on  acceleration  (2,  7).  The  apparent  inability  of  the  controller  to 
successfully  predict  the  accelerated  motion  of  targets,  and  hence  future 
positions  in  time,  was  associated  with  high  variability  in  performance. 

Third,  the  changes  in  ground  speed  of  a target  traversing  that  part  of  the 
MLS  course  that  curved  toward  the  airport  were  difficult  to  assess.  The 
controllers  reported  that  the  point  in  time  when  the  ground  speed  began,  to 
slow  was  not  immediately  apparent  nor  was  it  possible  to  accurately  predict 
the  future  motion  of  targets:  The  large  magnitude  of  the  change  in  ground 
speed  in  those  MLS  courses  with  long  curved  segments  made  accurate  perceptions 
difficult  and  inaccurate  performance  most  evident  in  the  results.  The  accel- 
erations that  occurred  within  the  curving  courses  were  most  significant  under 
the  wind  condition  and  posed  a situation  which  the. controllers  were  unable  to 
gauge  precisely. 

On  the  basis  of  discussions  with  the  controllers  after  the  Experiment, 
it  would  appear  that  the  controllers'  attempt  to  separate  the  two  targets  by 
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60  sec  at  the  MAP  was  not  accomplished  merely  by  estimating  time.  Rather, 
they  used  a time-di stance  conversion  (distance  = airspeed  x time).  This  was 
not  surprising  since  controllers  perform  their  normal  ATC  duties  using  mile- 
age not  time  as  the  separation  criterion,  and  consequently  they  were  faced 
with  a novel  and  difficult  task. 

Two  factors  involving  time  and  distance  conversions  were  involved.  The 
first  concerned  a principle  that  specific  separation  in  time  between  two 
targets  will  remain  constant  if  the  ground  speeds  of  the  two  targets  remain 
unchanged.  Secondly,  separation  in  time  will  remain  constant  when  ground 
speeds  change  if,  and  only  if,  the  place  and  rate  of  change  of  ground  speed 
of  one  target  is  identical  to  that  of  the  other.  The  realization  of  these 
phenomena  led  to  another  point.  Since  time  separation  was  held  constant 
between  the  targets  during  the  automatic  speed  reduction  (under  conditions 
heretofore  described),  the  establishment  of  60-sec  separation  between  targets 
prior  to  the  commencement  of  the  speed  reduction  (which  entailed  accelerated 
motion)  was  seen  as  desirable.  Once  the  automatic  speed  reduction  began,  the 
controller  had  no  means  of  adjusting  the  airspeed  of  a target.  This  required 
action  to  be  taken  earlier  in  order  to  have  control  capability  of  a useful 
and  realistic  magnitude  and  to  set  up  a relationship  between  the  two  targets 
when  they  proceeded  at  a constant  velocity.  Since  the  judgment  of  constant 
velocities  is  more  accurate  than  accelerated  velocities,  the  controller  was 
able  to  judge  the  separation  in  time  more  precisely  when  targets  moved  at 
constant  rates. 

The  results  of  the  present  experiment  indicate  that  the  control  of 
aircraft  using  an  MLS  with  curved  courses  and  temporal  separation  may  be 
subject  to  a number  of  limiting  factors.  The  different  path  combinations  had 
an  effect  on  both  the  mean  separation  between  targets  and  the  variability  of 
the  controller's  performance  under  the  wind  condition.  Under  the  no-wind 
condition,  there  was  little  difference  in  performance  by  path  combination. 

The  controllers'  comments  indicated  that  they  attributed  this  to  their  care- 
ful and  precise  attention  to  the  position  of  the  targets  with  reference  to 
hash  marks  and  the  calculation  of  time-distance  equations.  The  wind  condition 
posed  more  serious  difficulty  since  the  use  of  hash  marks  and  the  time- 
distance  equation  did  not  provide  information  which  could  be  used  to  compen- 
sate for  the  perceptual  factors  associated  with  the  wind. 

In  consideration  of  the  perceptual  factors  involved  in  controller 
performance,  it  seems  unlikely  that  the  addition  of  any  appreciable  workload 
(in  the  form  of  more  targets)  would  permit  positive  and  accurate  control.  One 
of  the  most  important  influences  on  performance  is  workload.  It  may  be  ^ 
measured  by  the  nun*er  of  targets  a controller  has  to  deal  with  at  one  time. 

By  current  standards  in  the  current  ATC  system,  with  complicating  intersecting 
and  converging  routes,  a light  workload  might  be  five  targets;  a heavy  work- 
load might  reach  as  high  as  15  targets.  In  this  experiment,  which  employed 
only  two  targets  at  one  time,  the  workload  was  minimal  yet  the  variability 
in  performance  with  wind  was  high.  This  was  true  in  spite  of  the  fact  that 
the  controller  had  enough  time  to  calculate  time-distance  relationships  for 
the  two  targets.  With  more  than  two  targets,  it  is  not  likely  that  the  con- 
troller would  be  able  to  maintain  the  mental  strategies  of  control  found  in 
this  experiment.  Furthermore,  an  increase  in  workload  that  would  reflect  a 
busy  teminal  area  would  make  accurate  and  successful  separation  between 
aircraft,  with  time  as  the  separation  criterion,  a most  unlikely  occurrence. 


598 


Yet,  innovations  in  ATC  systems,  cockpit  displays,  and  possible  alterations 
of  the  MLS  configuration  may  alleviate  some  of  the  problems  that  faced 
controllers  in  this  simulation.  Such  improvements  may  allow  conventional 
radar  ATC  using  the  MLS  with  a real  world  workload. 
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TABLE  1 


Analysis  of  Variance  for  Mean  Separation 
Time  Between  Aircraft  Targets  at  the 
MAP 


I 


Source 

1 

df 

< 

MS 

Error  Term 

F 

Order  of  presentation 
of  wind  condition  (A) 

1 

18.15 

D 

.03 

Path  C(Mub1  nation  (B) 

4 

589.68 

B X D 

3.83® 

Mind  condition  (C) 

1 

258.13 

C X D 

.48 

Subjects  (D) 

6 

655.18 

l\  X B 

4 

46.23 

B X 0 

.31 

ft  X C 

1 

200.66 

C X D 

.37 

B X C 

4 

532.82 

B X C X D 

6.48^* 

i X 0 

24 

163.66 

6 

542.16 

4 

63.02 

B X C X D 

.77 

3 X C X D 

24 

1 

82.19 

1 

® p<,05 

^ p<.01 
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TABLE  2 


. Analysis  of  Variance  of  Range  About 
Mean  Separation  Times  between  Aircraft 
Targets  at  the  MAP 


ft  ' 


Source 

r * 

df 

MS 

Error  Term 

i 

F 

Order  of  presentation 

1 

68.45 

0 

.07 

of  wind  condition  (A) 

Path  combination  (B) 

4 

556.32 

B X 0 

.98 

Wind  condition  (C) 

1 

11,092.05 

C X D 

12.42® 

Subjects  (D) 

6 

929.25 

A X B 

4 

451.45 

B X D 

.80 

A X C 

1 

344.45 

C X D 

.39 

B X C 

4 

551.98 

B X C X D 

1.03 

B X D 

24 

565.02 

C X D 

6 

892.91 

A X B X C 

4 

178.89 

B X C X D 

.33 

1 

B X C X 0 

24 

536.10 

4 

1 

* 

® p<,05 
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TABLE  3 


Summary  of  Mean  Separation  Times  (In  seconds) 
between  Aircraft  Targets  at  the  MAP  by 
Path  Combination  and  Wind  Condition 


< 


— 
Path  combination 

f r 1 f r 1 i 1 

— 

Wind  condition 

no-wind 

wind 

across  no-wind/wInd 

v-v 

62.6 

71.5 

67.1 

V-6 

58.  T 

56.2 

57.1 

V-A 

59.1 

41.4 

50.2 

V-P 

65.4 

52.4 

58.9 

V-M 

57.7 

63.4 

60,6 

Across  all  path 

combinations 

60.6 

57.0 

58.8 
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TABLE  4 
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Summary  of  Average  Ranges  (In  seconds)  about  (tean 
Separation  Times  between  Aircraft  Targets  at 
the  MAP  by  Path  Combination  and  Mind 
Condition 


# f t 


Path  combination  • 

f ( 

Mind  condition 

r " ‘ 

no-w1nd 

wind 

acros-^  no-wi nd/wind 

v-v 

19.1 

24.8 

21.9 

V-G 

20.9 

54.5 

37,7 

V-A 

20,1 

42.9 

31.5 

V-P 

24.0 

45.1 

34.6 

V-H 

14,1 

48.8 

31.4 

Across  all  path 

combinations 

t 

19.6 

1 

1 

43,2 

31,4 
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MEAN  SEPARATION  TIME 


RANGE  ABOUT  MEAN 
SEPARATION  T'ME 


PATH  COMBINATION  OF  AIRCRAFT  TARGET  MOVEMENT 


Figure  2.-  Mean  separation  time  and  range  about  mean  separation  time  between 
aircraft  targets  at  the  MAP  by  path  combination. 
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Figure  3.-  Average  range  about  mean  separation  time  between  aircraft  targets 
at  the  MAP  by  path  combination  and  wind  condition. 
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ABSTRACT 


This  paper  reviews  the  resvilts  of  driving  simulator  and  in-vehicle  field 
test  experiments  of  alcohol  effects  on  driver  risk  taking.  The  objective  was 
to  investigate  changes  in  risk  taking  under  alcoholic  intoxication  and  relate 
these  changes  to  effects  on  traffic  safety. 

The  experiments  involved  complex  15  minute  driving  scenarios  requiring 
decision  making  and  steering  and  speed  control  throughout  a series  of  typical 
driving  situations . Monetary  rewards  and  penalties  were  employed  to  simulate 
the  real-world  motivations  inherent  in  driving.  A full  placebo  experimental 
design  was  employed,  and  measures  related  to  traffic  safety,  driver/vehicle 
performance  and  driver  behavior  were  obtained. 

Alcohol  impairment  was  found  to  increase  the  rate  of  accidents  and  speed- 
ing tickets . Behavioral  measures  showed  these  traffic  safety  effects  to  be 
due  to  impaired  psychomotor  performance  and  perceptual  distortions.  Subjec- 
tive estimates  of  risk  failed  to  show  any  change  in  the  drivers'  willingness 
to  take  risks  when  intoxicated. 


INTRODUCTION 


Alcohol  has  been  shown  to  be  overrepresented  in  accident  statistics 
(Refs . 1 and  2) . Recent  surveys  have  subdivided  accident  causation  into  a 
variety  of  factors  including  vehicle,  environmental  and  driver  factors 
(Ref.  5).  Driver  behavior  can  be  further  subdivided  roughly  into  percep- 
tion, psychomotor  skill  and  higher  cognitive  factors  including  decision 
making.  Alcohol  effects  on  driver  psychomotor  skill  in  steering  control 
have  been  previously  studied  in  some  detail  (Ref.  4),  and  the  objective  of 
the  work  reported  here  was  to  investigate  the  alcohol  impairment  in  driver 
decision-making  situations . 


* 

This  work  was  supported  by  the  Office  of  Driving  and  Pedestrian  Research, 
National  Highway  Traffic  Safety  Administration,  Department  of  Transportation, 
The  views  expressed  in  this  paper  are  those  of  the  authors  and  do  not  neces- 
sarily represent  those  of  the  National  Highway  Traffic  Safety  Administration. 
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An  important  aspect  of  this  research  was  to  determine  whether  driver  risk 
taking  changes  with  Blood  Alcohol  Concentration  (BAG)  and,  further,  to  parti- 
tion the  changes  in  risk  taking  into  changes  in  driver  perception,  psycho- 
motor factors  and  the  acceptance  of  risk.  These  three  factors  combine  to 
determine  performance  in  a decision-making  task  and,  singly  or  in  combination, 
give  rise  to  performance  that  we  objectively  observe  as  risk  taking . Take, 
for  example , the  situation  where  a driver  has  run  a red  light . This  could  be 
due  to  the  driver's  having  misperceived  his  speed  or  the  time  interval  of  the 
amber  light;  it  could  also  be  due  to  the  fact  that  he  took  too  long  in  makiiig 
a decision  and  thus  his  reaction  time  for  accelerating  or  braking  to  a safe 
stop  was  delayed;  or  the  driver  may  merely  have  elected  to  accept  the  risk  of 
running  a red  light  because  he  was  motivated  to  minimize  the  delays  caused  by 
stopping . 

In  previous  research  on  driver  risk  taking,  no  consistent  approach  has 
been  used  to  differentiate  between  the  various  factors  contributing  to  deci- 
sion task  performance . Several  studies  have  measured  driver  risk  taking, 
which  has  been  foxmd  to  increase  with  BAG  (blood  alcohol  concentration) 

(Refs.  5-7).  More  recently,  however,  it  was  found  in  a gap  acceptance  task 
using  significant  rewards  and  penalties  that  intoxicated  subjects  did  not 
consciously  accept  greater  risks  (Ref.  8).  Impaired  psychomotor  skill  did 
result  in  degraded  performance,  however. 

The  inconsistency  in  past  research  has  been  in  the  definition  and  simula- 
tion of  driver  risk  taking,  the  analysis  of  all  behavior  components  in  risk 
taking,  and  the  use  of  tangible  risks.  Based  on  a review  of  the  literature, 
the  following  elements  were  felt  to  be  essential  to  adequately  determine  the 
effects  of  alcohol  on  driver  decision  making:  l)  division  of  driver  behavior 

into  perceptual,  psychomotor  and  cognitive  components;  2)  use  of  rewards  and 
penalties  to  simulate  real-world  risks  (e.g.,  accidents,  tickets,  lost  time); 
5)  use  of  tasks  which  simulate  the  temporal  pressure  of  normal  driving.  The 
experimental  methods  for  accomplishing  these  goals  are  discussed  below. 


EXFERIMBimL  METHODS 


Approach 

This  research  was  accomplished  in  two  separate  experiments,  the  first  a 
simulator  study  and  the  second  involving  field  validation  trials.  The  two 
experiments  were  designed  to  be  as  similar  as  possible  in  order  to  allow 
direct  comparison  of  results . The  specific  setup  for  each  was  as  follows . 

Simulation . The  simulation  was  configured  to  present  a plausible  driving 
scenario,  requiring  both  steering  and  speed  control  in  driving  decision- 
making situations.  The  functional  details  of  the  simulation  have  been  des- 
cribed previously  (Ref.  9).  Basically,  the  simxiLator  consisted  of  an  actual 
car  cab  and  controls  with  a two  lane  roadway  drawn  on  a 0.25  x 0.32  m 
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(10”  X 12”)*  CRT  mounted  on  the  cab  cowl  0.76  m (50  in.)  in  front  of  the 
driver  as  illustrated  in  Fig . 1 . Equations  of  motion  for  the  car  steering 
and  speed  control  were  solved  on  an  aneilog  computer,  which  generated  car 
heading  angle,  lateral  position,  and  forward  speed  in  response  to  steering 
wheel,  accelerator  and  brake  commands . The  car  motion  variables  drove 
special  pu3cpose  electronic  circuits  which  generated  a dashed  line  two  lane 
roadway  [5*65  m (l2  ft)  lane  width]  with  0.?6  m (2.5  ft)  shoulders.  The 
roadway  was  presented  in  correct  perspective,  but  reduced  scale  (roughly 
two-thirds)  in  order  to  fit  on  the  CBT  and  yet  subtend  a 22  degree  percep- 
tual field  of  view. 

Driving  events  were  controlled  by  a paper  tape  programmer  at  a rate  pro- 
portional to  forward  speed.  From  a cross  section  of  the  many  typical  driving 
decision-making  situations  three  events  were  selected  that  could  be  easily 
implemented  in  a laboratory  simulation.  The  functional  details  of  each  event 
and  related  measurements  are  described  further  on. 

Field  Validation.  This  study  was  conducted  in  an  instrumented  vehicle 
described  elsewhere  (Ref.  10).  Special  equipment  was  added  to  allow  the  car 
to  interact  with  the  test  course.  A photo  detector  mounted  on  the  vehicle 
sensed  reflective  strips  on  the  test  course  and  triggered  a programmer  which 
controlled  event  sequences  in  the  field  course  driving  scenario.  Instrumen- 
tation was  also  added  to  allow  experimenter  feedback  in  scenario  conditions 
and  subject  progress.  Details  of  the  field  setup  are  illustrated  in  Fig.  2. 


Driving  Tasks  and  Measurements 

The  driving  scenario  was  designed  to  allow  inq>lementatlon  both  in  the 
simulator  and  on  the  field  course.  A variety  of  events  were  considered,  and 
events  that  could  be  conveniently  mechanized  were  selected  for  each  e:q)eri- 
ment  as  indicated  in  Table  1 (Ref.  11 ).  A signal  light  situation  was  selected 
as  a classical  single  stage  decision  event.  Vehicle  control  in  a curve  was 
selected  to  investigate  the  large  number  of  single  vehicle  loss  of  control 
accidents  that  occur  with  alcohol  involvement  (Ref.  12).  The  remaining 
situations  selected  from  Table  1 involve  divided  attention,  a driver  behav- 
ior factor  which  has  been  shown  to  be  sensitive  to  alcohol  inq)airment  (Ref. 

1 3) • Details  of  the  driving  tasks  and  overall  scenario  were  as  follows . 

Signal  Light.  A model  signal  light  was  mounted  directly  above  the  hori- 
zon of  the  roadway  display  in  the  simulator  (Fig.  la),  and  an  actual  signal 
light  was  set  up  on  the  test  course  in  the  field  validation  study  (Fig.  2a). 
Signal  timing  was  controlled  as  a function  of  car  speed  and  distance  from  the 
intersection  in  order  to  control  the  time-to-go  to  the  intersection.  Several 
timing  conditions  were  used  ranging  from  a sure  stop  to  a sure  go.  Details 
of  the  signal  timing  and  task  kinematics  have  been  presented  elsewhere  (Ref. 
11). 


*Customary  units  were  used  for  the  measurements  and  calculations  of  this 
study. 
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Figure  1 . Simulation  Setup 
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Figure  2.  Equipment  Setup  for  the  Field  Validation  Study 
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XABIiE  1 . DRmiiS  DECISION-MAEUW  SimHOHS 


DECISION 

BASIC  TYPE 

SPECIFIC  SITUATIONS 

SEI£CTED  TASKS 

C1AS3 

SIMULATION 

IN-VEHICLE 

Traffic 

e Signal  light 

X 

X 

Control 

• Course  navigation 

X 

Single 

Stage 

Unexpected 

• Car,  pedestrian,  object 

Threats 

unexpectedly  enters 
roadway 

X 

e Object  ia/on  roadway 

Sequential 

Maneuvers 

• Speed  and  steering 
control  in  a curve 

e Lane  changing  and 
merging 

• Hoad  entry  and  merging 

• Over+  og  and  passing 

X 

X 

The  perceptual  requirements  of  this  task  were  to  estimate  car  speed  and 
distance  to  the  intersection  which  the  driver  then  uses  to  determine  the 
probability  of  making  the  light.  Driver  perception  is  based  on  motion  of 
the  dashed  lines  and  the  intersection,  auditory  feedback  of  car  speed,  and 
position  of  the  intersection  when  the  light  changes  from  green  to  amber. 

The  driver  does  not  separately  estimate  speed  and  distance,  but  makes  a 
"Gestalt"  estimate  of  the  chance  of  entering  the  intersection  before  the 
light  turns  red.  The  amber  light  intei^al  was  held  constant  at  3 seconds 
which  is  typical  of  urban  signal  timi.ng. 

Driver  signal  timing  perception  was  measured  by  having  the  subjects 
verbally  repoi>t  their  chance  of  failing  to  make  a given  signal  situation 
Immediately  after  passing  through  the  intersection.  Failure  was  defined  as 
entering  the  intersection  after  the  light  had  turned  red.  This  amounts  to 
measurement  of  a subjective  probability  in  decision  theory  context,  and  care 
was  taken  to  insiure  that  these  estimates  were  unbiased  by  task  performance 
(Bef.  11),  Fsychomotor  performance  was  measured  in  terms  of  brake  reaction 
times  in  the  situations  where  the  driver  stopped. 

Curve.  The  curved  portion  of  the  simulation  and  field  test  driving- 
scenarios  (Pigs,  le  and  2a,  respectively)  required  specific  steering  and 
speed  control  in  order  to  avoxd  loss  of  control.  Tire  forces  were  limited 
in  the  simulator  equations  of  motion  such  that  peak  cu3rvatures  could  not 
be  negotiated  at  speeds  greater  than  about  k^h  (28  mph)  although  the 


614 


scenario  legal  speed  limit  was  set  at  ^2  ^aa/h  (45  mph) , Also  4o  )m/h  (24  mph) 
speed  advisory  signs  were  displayed  to  the  simulator  drivers  in  advance  of 
the  cu3Tves. 

In  the  field  test  a specieil  circuit  was  set  to  activate  an  alarm  at 
greater  than  0.5  e lateral  acceleration  in  order  to  simulate  a loss  of 
control  accident.  The  car  was  capable  of  0.7-0 .8  g turns  but  actual  loss 
of  control  had  to  be  avoided  for  safety  reasons . The  field  course  speed 
limit  was  4o  kny^h  (25  mph)  and  the  curve  radii  were  such  as  to  require 
significantly  lower  speeds  in  order  to  avoid  exceeding  the  imposed  g limit . 

The  critical  perceptual  task  in  the  curve  situation  was  speed  judgment. 
Speed  was  represented  by  visual  field  motion  and  auditory  feedback,  as  in 
the  signal  event,  plus  quantitative  readout  on  the  speedometer.  Use  of  the 
speedometer  is  more  appropriate  here  than  for  the  signal  event  because  of 
the  quantitative  nature  of  the  curve  limit  speed  and  a lower  time  pressure 
on  perception  and  psychomotor  action.  Perception  in  this  task  was  again 
measured  by  driver-reported  subjective  probability  of  crashing  which  was 
solicited  directly  after  curve  exit.  Speed  at  peak  curvature  was  obtained 
as  an  objective  measure  of  risk,  i.e.,  the  higher  the  speed,  the  greater 
the  risk.  Comparison  of  subjective  risk  estimates  with  speed  then  gives  a 
measure  of  driver  risk  perception  in  the  curve  situation. 

Divided  Attention.  In  the  simulator  the  divided  attention  situation 
involved  obstacle  avoidance.  This  task  consisted  of  a circular  object  at 
th”  right  side  of  the  displayed  roeuiway  which  sometimes  remained  stationary 
at  the  side  of  the  road  or,  more  frequently,  moved  laterally  into  the  sub- 
ject's (right)  lane  (Fig.  lb),  requiring  either  stopping  or  steering  avoid- 
ance. The  subject  also  had  to  contend  with  adjacent  cars  in  the  left  lane 
which  were  simvilated  by  a projected  slide  viewed  in  the  side  view  mirror 
(Ref.  9)«  Changing  lanes  in  the  presence  of  an  adjacent  car  led  to  a crash 
as  sim^ated  by  a buzzer  and  display  jitter.  Crashes  also  res^ilted  from 
striking  the  obstacle  or  running  off  the  road  shoulder. 

The  obstacle  avoidance  task  was  a conflict  situation.  The  subject  was 
encouraged  by  a time  reward  to  continue  going  if  possible,  but  was  penalized 
for  crashing  as  described  further  on.  This  task  primarily  provided  a measure 
of  the  driver's  visual  monitoring  and  steering  control.  Comments  were  solic- 
ited frm  subjects  on  monitoring  behavior  in  the  event  of  an  adjacent  crash. 

Mechanization  of  the  obstacle  avoidance  task  was  deemed  too  difficult 
for  the  field  study  so  a simple  route  guidance  task  was  substituted.  A dash- 
board mounted  indicator  was  used  to  direct  the  subject  either  left,  right  or 
straight  after  he  had  passed  the  signal  light  intersection.  51ie  course  lay- 
out and  timing  were  such  that  the  route  decision  was  made  under  a reasonable 
amount  of  time  pressure. 
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Srlvltii  Setnarlo  and  JUnu^HaAlty  Struetuv* 

Each  run  in  the  simulator  and  field  tests  consisted  of  an  approximately 
minute  drive  which  included  a pseudo-random  sequence  of  the  above  tasks. 
Program  staarting  points  were  varied  and  counterbalanced  between  subjects  in 
order  to  avoid  learning  the  eVent  sequences.  Circuits  for  detecting  red 
light  and  speeding  violations  were  activated  at  approximately  50  percent  of 
the  events  to  simulate  occasional  police  surveillance . 

Audio  alarms  were  activated  when  violations  were  detected,  and  when  the 
lateral  g limit  for  loss  of  control  was  exceeded  in  the  field  test.  A crash 
buzzer  was  activated  in  the  simulator  when  subjects  exceeded  the  road 
shoulder  limits,  or  zan  into  obstacles  or  adjacent  cars.  Accidents  in  the 
field  test  were  further  defined  by  striking  the  tires  and  cones  used  to 
define  the  edge  of  the  course  (Fig . 2a) . Thus  subjects  were  given  complete 
feedback  on  traffic  safety  related  variables  (accidents  and  tickets)  as 
they  would  in  the  real  world*  In  addition  the  number  of  accidents  and 
tickets  were  used  as  traffic  safety  measures  on  the  overall  driving  scenario 
and  were  also  accounted  for  in  the  reward/penalty  structure  as  described 
below. 

Subjects  were  instructed  to  behave  as  they  normally  would  in  a driving 
situation  with  a reasonable  motivation  for  timely  progress  while  avoiding 
traffic  violations  and  accidents.  In  addition,  the  monetary  reward/penalty 
structure  given  in  Table  2 was  used  to  simulate  real-world  driving  motiva- 
tions and  risks  (Ref.  li»),  and  provide  a quantitative  vidue  structure  for 
expected  value  modeling  of  decision-making  behavior  (Ref.  15)*  Tbe  overall 


TABI.B  2.  REMARD/PBSAIJTY  STRUCTURE  FOR  SIMULATING 
REAL-WORLD  MOTIVATIOKS  IN  DRIVERS 


COMPONENT 

LAB 

SIMULATION 

HELD 

VALIDATION 

Run  completion  bonus 

$10 

$10 

Time  saved  reward 

$2/min 

$2/min 

Low  ticket  penalty  group 

$l/ticket 

$l/ticket 

High  ticket  penalty  groqp 

$2/ticket 

Accident  penalty 

$2/crash 

$2/crash 

Route  error  penalty 

— 

$0 .50/error 
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scaling  of  the  structure  was  siade  large  enough  to  be  meaningful  and  compara- 
ble to  the  subjects*  hourly  wages.  The  run  completion  bonus  was  Included  to 
Insure  subjects  completing  each  run,  t id  the  time  saved  reward  was  set  to 
encourage  the  subjects  to  make  timely  ^^rogress  on  the  drives  and  not  become 
excessively  cautious.  Penalties  were  assessed  for  tickets,  accidents  and 
route  errors  (traffic  safety  factors).  Ticket  penalties  are  one  factor  that 
can  be  manipulated  in  the  real-world  (i.e.,  traffic  court  fines)  and  a be- 
tween group  comparison  was  included  for  two  levels  of  this  variable.  Results 
of  the  simulator  study  showed  no  significant  differences  between  the  $1  and 
$2  penalty  groups  so  the  high  ticket  penalty  was  increased  to  $4  for  the 
field  experiment.  Results  on  th«  ticket  penalty  variation  are  fully  dis- 
cussed in  Ref.  l4. 


Staign,  Treatiamtt  and  Rrooedurei 

Subjects  were  selected  from  the  male  licensed  driving  population  through 
a newspaper  ad  and  screened  to  insure  heavy  drinking  tendencies  (defined  as 
the  capability  for  reaching  a peak  BAG  of  0.15).  Based  on  age  and  scores  on 
a hostility  test  (Ref.  l6)  and  betting  test  (Ref.  17)>  subjects  were  matched 
and  divided  into  the  two  penalty  groups.  During  training  sessions  subjects 
were  given  several  one-half  hour  exposures  to  the  simulated  driving  scenarios 
and  reward/penalty  structure  in  order  to  miniodze  learning  effects  during  the 
formal  data  sessions. 

The  experimental  design  shown  in  Pig.  3 was  completed  by  12  subjects  in 
the  simulator  experiment  and  at  a later  date  by  a different  group  of  lk  sub- 
jects in  the  field  tests.  Session  order  was  counterbalanced  between  subjects. 
Performance  was  measured  in  four  separate  runs  during  sessions  of  nominally 
eight  hours  in  length.  During  alcohol  days  rims  were  administered  at  sober, 
ascending,  peak  and  descending  levels  of  Bloo<i  Alcohol  Concentration  (BAG) 
in  the  simulator  tests.  The  ascending  BAG  runs  were  subsequently  dropped  in 
the  field  tests  based  on  minimal  differences  in  sim\>lator  performance  levels 
on  the  ascending  and  descending  portions  of  the  BAG  curve.  During  placebo 
days  runs  were  administered  at  roughly  the  same  times  as  on  the  alcohol  days . 
Thus  subjects  served  as  their  own  controls  for  alcohol  effects,  and  penalty 
structure  was  between  groqp  effect. 

Actual  times  and  blood  alcohol  levels  are  illustrated  in  Pig.  BAG 
was  measured  with  a gas  chromatograph  breath  analyzer.  Placebo  drinks  were 
made  by  floating  a small  amount  of  liquor  on  top  of  mixer.  Subjects  were 
allowed  to  select  their  own  mixed  drinks  in  order  to  maximize  subject  morale; 
however,  combinatioiwt  which  would  not  allow  credible  placebos  were  tactfully 
avoided.  Alcohol  was  administered  proportional  to  body  weight  in  three  drinke. 

The  facility  layout  and  personnel  assignments  were  designed  to  maintain 
subject  motivation  and  experimental  efficiency.  Recreational  areas  were  set 
up  adjacent  to  the  simulator  and  included  a bar^  breath  test  area,  lounge  and 
dining  area,  and  a restroom.  This  provided  a relaxing  atmosphere  for  the 
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subjects  between  experimental  trials  and  isolated  them  from  laboratory  acti- 
vity other  than  when  they  were  being  tested. 


BESUI/ES  AM)  DISCUSSION 


Overall  Performance 

Performance  measures  accumulated  over  the  whole  driving  scenario  are 
plotted  in  Fig.  5,  which  show  excellent  agreement  between  the  simulation 
and  field  test  experiments . The  total  payoff  per  run  gives  an  overall 
combined  performance  measure  of  the  reward/penalty  structure  components . 
Average  payoff  was  appreciably  affected  by  BA.C  as  illustrated  in  Fig.  5a. 
Sober  subjects  were  making  an  average  $12.50  per  run,  which  dropped  to  $5 
at  the  peak  BAG  condition.  Analysis  of  variance  procedures  (AWOV)  proved 
these  results  to  be  reliable  (P  < 0.01 ),  but  showed  no  significant  differ- 
ence between  the  two  ticket  penalty  groups.  The  payoff  levels  were  quite 
substantial,  as  the  average  sober  subject  made  roughly  $30-50  during  his 
placebo  session,  and  subject  comments  indicated  these  payoff  levels  moti- 
vated performance. 

Component  measurers  of  the  reward/penalty  structure  are  also  given  in 
Fig.  5,  Average  driving  time  to  complete  the  driving  scenario  (Fig.  5b) 
was  remarkably  insensitive  to  BAG,  while  speeding  tickets  and  accidents 
were  appreciably  elevated  with  BAG  (Figs . 5c  and  5<i) . Since  driving  com- 
pletion time  was  constant,  the  increased  incidence  of  speeding  tickets  with 
BAG  implies  increased  speed  variability . Subjects  were  well  aware  of  the 
speed  limit  and  speeding  penalty,  and  feedback  of  speed  was  available  both 
visually  v'.rd  aurally.  Thus,  increased  speed  variability  sviggests  decrements 
in  perception  and/or  speedometer  monitoring. 

Considering  a speed  versus  accuracy  paradigm,  it  is  apparent  here  that 
these  subjects  maintained  average  speed  levels  (and  thus  average  rate  of 
event  occurrence)  under  alcohol  impairment  at  the  expense  of  accuracy 
(increased  tickets  and  accidents).  Thus  risk  taking  increased  with  BAG, 
but  the  question  remains  as  to  whether  the  drivers  were  aware  of  the  in- 
creased risk  and  thus  were  willingly  accepting  greater  risk. 

The  simulator  driving  scenario  provided  for  three  t3rpes  of  accident 
exposure,  and  these  accident  results  are  plotted  in  Fig.  6.  Crashes  on 
the  curve  resulted  from  excessive  speed  and/or  poor  steering  control  and 
were  the  most  prevalent  accident . The  adjacent  car  crashes  arose  from  the 
driver  not  monitoring  his  rearview  mirror  when  he  decided  to  steer  around 
the  obstacle  (subject  reported).  This  result  is  consistent  with  previously 
reported  moaitoring  failures  in  driving  situations  (Ref.  4).  Observations 
dxuring  the  experiment  indicated  that  obstacle  crashes  occurred  either  because 
the  driver  took  too  long  to  decide  to  stop  and  then  hit  the  obstacle,  or 
tried  to  steer  around  and  clipped  it  from  the  side. 
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Figure  5.  Overall  Driving  Scenario  Performance  Measures 
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Figure  6.  Simulator  Curve,  Adjacent  Car  and 
Obstacle  Crash  Results 


The  relative  increase  in  experimental  accident  rate  with  BAC  is  compared 
with  real-world  data  (Ref,  l8)  as  shown  in  Fig.  7*  Although  there  is  some 
difference  between  the  two  experiments  reported  here  (primarily  due  to  dif- 
ferent placebo  accident  rates),  the  data  are  still  consistent  with  epidemio- 
logical statistics.  The  knee  of  the  experimental  data  occurs  in  the  region 
of  0,10  BAC  and  the  data  bracket  the  real-world  rates.  This  data  thus  lend 
credibility  to  alcohol  sensitivity  of  our,  simulated  driving  scenarios . 


Signal  Light  Behavior 

The  probability  of  going  on  a given  signal  timing  condition  and  the 
driver's  estimate  of  failure  (i,e.,  running  the  red  light)  are  plotted  in 
Fig.  8.  There  were  5 signal  timings  randomly  distributed  throughout  the 
scenario,  and  the  amber  light  timing  was  set  to  change  the  light  when  the 
driver  was  5 seconds  from  the  intersection  (traveling  at  constant  speed) 
in  the  simulator  and  k,2  seconds  in  the  field  test  for  the  data  illustrated. 
The  amber  light  interval  was  only  3 seconds  long  so  the  subjects  would  invari- 
ably run  the  red  light  under  these  conditions  if  they  decided  to  go.  Tliere 
was  some  probability  of  going  under  this  condition,  however,  which  increased 
under  alcohol. 
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Figure  7*  Comparison  of  Experimental  Accidents 
With  Real  World  Data  (after  Hurst,  Ref.  18) 
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Figure  8.  Signal  Light  Behavior  Probability  of  Going  and  Driver 
Es-cimates  of  Failure  (Running  the  Red  Light)  Given  a Go 


The  drivers'  subjective  estimates  of  failure  given  that  they  decided  to 
go,  SP(f/g),  are  consistent  with  the  probability  of  going.  In  the  simulation 
experiment  variability  in  the  estimates  increased  with  BAG , If  we  hypothe- 
size a risk  acceptance  threshold  for  going,  we  see  that  the  increased  varia- 
bility leads  to  an  increased  probability  of  going.  In  the  field  test  a 
combination  of  increased  variability  and  lower  mean  estimate  of  risk  led  to 
increased  probability  of  going. 

The  subjects'  failure  probability  estimates  were  obtained  as  soon  as 
possible  after  passing  through  the  intersection  on  randomly  selected  events 
where  the  subject  did  not  receive  a ticket  (the  police  circuit  was  activated 
only  30  percent  of  the  time) . In  order  to  check  for  performance  biasing 
(probability  estimates  influenced  by  events  after  the  decision  point),  a 
separate  set  of  runs  were  conducted  in  the  simulation  where  the  whole  road- 
way display  and  signal  light  were  blanked  at  the  end  of  the  amber  light 
interveCL,  The  estimates  were  no  different  under  these  circumstances  than 
when  the  task  was  carried  to  completion.  These  results  indicate  that  the 
failure  estimates  were  a reflection  of  the  drivers'  perception  or  "Gestalt" 
of  the  time  distance  relationship  existing  at  the  appearance  of  the  amber 
light  and  the  decision  point.  These  points  and  a complete  decision  theory 
analysis  of  the  signal  light  behavior  is  given  elsewhere  (Ref.  15). 

Brake  response  time  on  the  signal  light  task  was  used  as  a measure  of 
signal  task  psychomotor  behavior.  The  results  in  Fig.  9 show  no  effect  of 
alcohol  on  either  the  mean  or  variability  in  response  time. 


Broke 

Response 


Broke 

Response 

Time 

(sec) 


Placebo  Trial 
Alcohol  Trial 


Field 


Simulator 


Sober 


2 

Ascending 


3 

Peak 


4 

Descending 


Figure  9»  Alcohol  Effects  on  Brake  Response  Time 
in  the  Signal  Light  Task 
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Curve  Behavior 


Drivers  had  to  carefully  control  speed  on  the  curves  to  avoid  loss  of 
control.  As  illustrated  in  Fig.  tO,  drivers  did  maintain  safe  speeds  on  the 
average  with  no  significant  effect  due  to  BAG  level.  However,  speed  varia- 
bility between  curves  (computed  across  several  repeat  curves/run/ subject) 
did  significantly  increase  under  peak  BAG.  ANOV  procedures  showed  this 
effect  to  be  significant  at  the  O.05  level.  By  taking  into  account  the 
speed  mean  and  standard  deviation  values  and  assuming  a normal  distribution, 
we  can  compute  the  probability  of  exceeding  the  critical  curve  speed,  which 
should  equal  the  probability  of  crashing.  In  Fig.  11  computed  and  measured 
crashed  probabilities  for  the  simulator  data  are  compared.  The  computed 
probabilities  show  an  increase  in  the  region  of  peak  BAG,  but  are  generally 
lower  than  the  data  by  50  percent . In  the  field  test  the  mean  and  varia- 
bility does  not  explain  the  increase  in  accident  rate  (field  accidents  were 
primarily  due  to  g limit  exceedences  in  the  curves) . However,  experimenters 
noted  that  g exceedence  often  occurred  with  steering  corrections.  Steering 
actions  by  the  driver  can  exceed  the  g limit  at  speeds  below  the  critical 
speed.  In  the  linear  region  of  tire  force  characteristics,  lateral  accelera- 
tion for  a neutral  steer  car  can  be  expressed  approximately  as  a function  of 
the  car’s  speed  (Uq),  wheelbase  (a  +b),  and  front  wheel  steer  angle,  8^,: 


a + b ^ ^ ^max 

The  driver  could  enter  a curve  and  establish  safe  steady-state  conditions 
(i.e.,  constant  Uq  6w),  then  provide  steering  corrections  which  command 
laterail  accelerations  beyond  the  acceleration  limit  according  to  the  above. 
As  noted,  the  higher  the  speed  (Uq),  the  less  additional  steering  angle  can 
be  tolerated  before  the  tires  reach  their  acceleration  limit.  Errors  in 
this  mode  might  result  from  the  driver  not  establishing  a large  enough  steer- 
ing angle  at  the  beginning  of  the  curve,  then  having  to  make  a correction  in 
midcourse  which  is  beyond  the  acceleration  limits  of  the  tires. 

Subjective  estimates  of  risk  or  ’crash'  probability  were  obtained  in 
both  studies  at  the  end  of  selected  curves . No  effect  of  alcohol  was  noted 
on  these  estimates . Thus  in  spite  of  the  increased  accident  rate  under 
alcohol  which  was  primarily  due  to  loss  of  control  on  curves,  drivers  did 
not  exhibit  any  perception  of  the  elevated  risk. 
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Figure  10.  Mean  and  Variability  of  Speed  on  Curves 
in  the  Simulator  and  Field  Driving  Scenarios 
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Figure  11 , Comparison  of  Actual  and  Computed  Curve  Crash  Probabilities 
for  the  Simulator  Driving  Scenario 


SUMtABY  AND  CONCIUDXNQ  RmSKB 


Overall  performance  on  the  driving  scenario,  as  measured  by  accumulated 
payoff  according  to  a reward/penalty  structure,  was  appreciably  degraded  by 
BAC  (blood  alcohol  concentration) . Penalties  due  to  accidents  and  speeding 
tickets  increased  with  BAC  and  were  primarily  responsible  for  the  decline 
in  payoff. 

Increased  speed  variability  under  alcohol  was  responsible  for  the  in- 
crease in  speeding  tickets  and  curve  accidents.  On  the  average  drivers  did 
not  perceive  the  increased  hazard  of  the  curve  task  with  alcohol  impairment 
as  indicated  by  subjective  estimates  of  riskj  however,  speed  variability  did 
increase,  probably  due  to  impaired  perception  of  speed.  Similarly,  going 
behavior  on  the  signal  task  increased  under  alcohol  due  to  an  increase  in 
the  variability  of  risk  perception. 

The  above  changes  in  speed  variability  and  signal  risk  perception  with 
increased  BAC  imply  perceptual  impairment  unknown  to  the  drivers.  Alcohol 
increased  perceptual  variability  which  Increased  the  driver's  risk  exposure. 
However,  the  mean  level  of  subjective  risk  estimates  was  unchanged  with 
alcohol  in  this  experiment,  which  indicates  the  subjects  were  not  aware  of 
their  increased  risk  exposure.  The  incidence  of  tickets  and  accidents  under 
alcohol,  although  increased,  was  still  a low  probability  event  (roughly  1 .5 
and  1 incident  per  subject  per  run,  respectively,  at  the  peak  BAC  level) . 
Although  degraded  psychomotor  skill  and  perception  combined  to  increase  the 
changes  of  violations  and  accidents  under  alcohol,  the  subjects  were  not 
aware  of  these  changes  in  risk. 
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ABSTRACT 


A decision  model  including  perceptual  noise  or  inconsistency  is  developed 
from  expected  value  theory  to  explain  driver  stop  and  go  decisions  at  signaled 
Intersections,  The  model  is  applied  to  behavior  in  a car  simulation  and  instru- 
mented vehicle.  Objective  and  subjective  changes  in  driver  decision  making 
were  measured  with  changes  in  blood  alcohol  concentration  (BAG),  Treatment 
levels  averaged  0,00,  0.10  and  O.lU  BAG  for  a total  of  26  male  subjects.  Data 
were  taken  for  drivers  approaching  signal  lights  at  three  timing  configura- 
tions, The  correlation  between  model  predictions  and  behavior  was  highly 
significant.  In  contrast  to  previous  research,  analysis  indicates  that 
increased  BAG  results  in  increased  perceptual  inconsistency,  which  is  the 
primary  cause  of  increased  risk  taking  at  low  probability  of  success  signal 
lights. 


OITRODDCTICIT 


One  of  the  motivations  for  developing  the  driver  decision  model  described 
here  was  to  measure  and  analyze  the  behavior  of  alcohol- impaired  drivers.  We 
desired  to  separate  risk  taking  into  components  of  risk  perception  and  accept- 
ance^, If  a driver  takes  increased  risks,  is  it  because  he  perceived  the  risK 
and  decided  to  accept  it  or  because  he  does  not  perceive  the  Increased  risk? 
Expected  value  theory  provides  a simple  construct  for  making  this  distinction 
and  has  been  applied  in  the  past  to  describe  iaspaired  driver  behavior,  (Refer- 
ences 1,  2,  and  5), 

Here  we  apply  a Subjective  Expected  Value  (SBV)  model  to  explain  driver 
stopping  and  going  behavior  at  signaled  intersections.  Perceptual  noise  is 
included  to  reflect  one  type  of  driver  inconsistency  in  the  decision-making 
process  (Reference  5)*  The  model  is  applied  to  data  collected  as  part  of  an 
automobile  simulator  study  involving  a typical  drive-home  scenario.  Although 
measures  were  taken  throughout  the  scenario  on  several  tasks,  we  concentrate 
here  on  signal  light  behavior.  We  briefly  present  the  decision  model,  the 
experimental  results,  and  our  analysis  and  interpretation  in  view  of  previous 
studies. 
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recisioir>iiuaiiG  model 


The  model  wes  derived  to  guide  experimental  design  and  measurement.  The 
expected  value  approach  is  not  new;  however,  the  Inclusion  of  perceptual  noise 
as  applied  to  signal  light  behavior  is  original.  The  basic  scenario  is  a sig- 
nal light  at  an  intersection  which  has  changed  from  green  to  amber  and  will 
change  to  red  in  5 seconds.  Based  on  his  perception  of  speed  and  distance  the 
driver  must  then  decide  whether  to  stop  or  go.  The  kinematics  for  this  task 
have  been  described  previously.  Reference  It.  Here  we  briefly  derive  an  appro- 
priate decision  model  subject  to  several  assunptions. 

We  begin  sinqpliiying  what  is  actually  a complex  declcion  task.  Refer- 
ence IT,  in  a simple  two-altemative  situation.  Conceptually  we  are  assuming 
this  decision  process  takes  place  in  parallel  with  the  driver's  continuous 
speed  control  behavior  as  Illustrated  in  Figure  1.  Perceptions  of  vehicle 


Figure  t.  Signal  Light  Risk  Acceptance  Model 


velocity  and  distance  to  the  signal  at  the  time  the  light  changes  to  ember  are 
used  to  form  a subjective  estimate  of  the  probabilities  of  success  and  failiure 
for  the  various  alternatives.  As  indicated  in  the  figure  and  discussed  fur- 
ther below,  these  subjective  probabilities  are  stochastic  in  nature.  They 
are  weighted  with  apprt^rlate  utilities  or  values  and  the  driver  selects  the 
alternative  with  the  highest  expected  value.  We  define  Subjective  Eiq?ected 
Valuer  (SEVs)  for  the  two  alternatives,  go  or  stop,  respectively; 

8BV(8top)  - 8P(ftt8s/8top)V(Pa88/8top)  + SP(FBll/8top)V(Ffeil/Stop)  (T) 
SBV(Go)  « SP(PaS8/Go)V(PB88/0o)  + 8P(F8ll/Go)V(F&il/Go)  (2) 
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where  SP(.)  and  V(»)  are  conditional  subjective  probabilities  and  values, 
respectively.  Prow  these  equations  and  the  several  other  simpliiVing  assuit^- 
tions,  we  can  express  the  probability  that  a driver  will  atteinpt  to  go  through 
the  signal  light.  Further  simplifying  notation  so  that  P = Pail  and  6 = Go, 
the  probability  of  Going  is: 

P(G)  = JJ  f[SP(F/G),  SP(P/S]  dSP(F/G)  dSP(P/S)  (5) 

Region 

where  the  region  is  defined  by: 

P(G)  = P[SEV(G)  > SBV(S)]  (k) 

With  the  assumptions  listed  in  Table  1,  it  can  be  shown  (see  Reference  6 
for  derivation)  that  the  P(G)  is  the  Gaussian  integral: 


P(G)  = 


/ 


SP.(P/G) 


exp 


‘^SP(F/G)>/^  o 


2‘^SP(F/G) 


TABLE  1 . SOME  MODEL  ASSUMPTIONS 


1 . Operator  select.'  decision  alternative  with  largest  subjective 
expected  value.  Values  reflect  utilities  and  are  constant. 

2.  Subjective  probabilities  are  mutually  exclusive  and  exhaustive. 

5.  Subjective  probabilities  are  Gaussian  random  variables  in  the 
region  of  interest, 

1)-.  Increased  SP(F/G)  decreases  P(G),  i.e.,  the  values  discourage 
go-failures. 

5.  The  verbal  estimates  of  SP(F/g)  linearly  reflect  subjective 
perception. 

6.  The  threshold  value  of  SP(P/G),  below  which  the  operator  selects 
the  go  alternative  is  SPg(p/G): 

• i SP(F/G)  where  P(G)  = 0.5 

% is  a constant  as  compared  with  being  a random  variable 

7.  SP(P/S)  =‘0. 
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A typical  example  of  these  concepts  is  illustrated  in  Figure  2.  Repeated 
observations  for  a given  situation,  e.g. , signals  with  the  same  time  to  the 
intersection,  result  in  a distribution  of  subjective  estimates  illustrated  by 
the  top  probability  density  curve.  Assuming  a cutoff  subjective  probability, 
SP^(F/G),  as  illustrated,  the  area  under  the  density  curve  and  to  the  left  of 
the  criterion  is  P(G).  This  is  illustrated  in  the  bottom  of  Figure  2,  where 
the  relationship  of  P(G)  as  a function  of  the  average  subjective  estimate, 
3P(F/G),  is  illustrated.  The  slope  of  this  relationship  is  determined  by  the 
variability  of  the  subjective  estimates,  ogp.  Note  that  the  effect  of  increas- 
ing the  variance  of  the  subjective  estimates  is  to  increase  P(G)  for  the  case 
illustrated.  Also  shown  is  the  consequence  of  a change  in  the  driver’s  risk 
acceptance,  SP<,(F/G). 


SPe(F/6) 


Tim*  (sec)  to  the  Intersection 

Figure  2,  Typical  Relationship  Between  Probability  of  Going,  P(G), 
Subjective  Probabilities  of  Fail  Given  a Go,  SP(f/G), 
and  Signal  Timing 
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A useful  eti5)irical  relationship  is  also  apparent  in  Figure  2.  Evaluation 
of  Eq.  p for  the  condition  SPc(f/g)  = SP(f/G)  results  in  pCg)  = 0-5.  Thus,  the 
subjective  cutoff  SPc(f/g)  can  be  determined  empirically  from  objective  behav- 
ior probabilities  by  selecting  the  value  of  SP(F/G)  at  P(G)  = 0.5. 


THE  smRiMEnis 


The  signal  light  task  was  simulated  in  both  a fixed“base  simulator  and 
instrumented  vehicle  on  a closed  course  as  described  in  the  coit5)anion  paper 
(see  Reference  l4).  The  signal  light  timing  was  controlled  similarly  in 
both  simulation  and  field  studies.  When  the  vehicle  approached  the  inter- 
section, the  signal  light  initially  turned  green.  At  a random-appearing 
time  later,  the  signal  turned  amber.  This  time  was  controlled  by  a circuit 
which  con^ensated  for  car  speed  such  that  the  time  interval  to  the  inter- 
section was  the  same  for  a given  intersection  type,  regardless  of  the  approach 
speed,  if  the  driver  maintained  that  speed.  The  amber  light  interval  was 
fixed  at  5 seconds,  following  which  the  light  turned  red.  Thus,  the  proba- 
bility for  successfully  making  a light  was  controlled  without  placing  an  arti- 
ficial speed  restriction  on  the  subject.  Five  signal  timings  were  automaticlly 
commanded.  One  was  set  to  require  a sure  stop  (early  yellow)  and  another  a 
sure  go  (long  green).  The  remaining  three  timings  ranged  from  a probable  stop 
to  a probable  go.  The  times  to  the  intersection  from  the  amber  light  typically 
ranged  from  2.0  to  5.5  seconds.  (The  kinematics  of  stopping  or  going  for  these 
timings  are  discussed  more  fully  in  Reference  h. ) 

The  subjects  were  instructed  to  behave  as  they  normally  would  in  a driving 
situation  with  a reasonable  motivation  for  timely  progress  and  a desire  to 
avoid  tickets  and  accidents.  Also,  a monetary  incentive  structure  was  pro- 
vided as  a tangible  and  quantifiable  motivation  for  performance  (see  Refer- 
ence 14). 

Subjects  were  trained  until  objective  performance  and  subjective  estimates 
were  consistent  in  the  view  of  the  experimenter.  Subjective  estimate  train- 
ing began  with  a short  tutorial  written  exam  used  as  a basis  for  discussion 
of  the  concepts  of  probabilities.  Following  this,  each  subject  received  two 
to  three  hours  of  practice  driving  in  half-hour  sessions  spread  over  two  days. 
Feedback  on  performance  and  subjective  estimates  was  given  throughout  these 
training  trials. 

Subjects  completed  trials  on  each  of  two  days.  During  an  alcohol  day, 
the  trials  corresponded  to  an  across-subject  average  blood  alcohol  concentra- 
tion (bag)  of  0.00  (baseline),  0.10  (ascending  — when  measured),  0.l4  (peak), 
and  0.10  (descending).  During  the  placebo  day,  the  trials  were  given  at 
approximately  the  same  time  of  the  day  as  for  the  above  trials.  The  day  order 
was  counterbalanced  among  subjects. 

Objective  and  subjective  measures  were  taken,  and  the  number  of  stop  and 
go  decisions  was  recorded.  The  number  of  failures  and  successes  for  each 
decision  was  detected  automatically  and  recorded  irrespective  of  whether  or 
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not  the  driver  received  a ticket.  Corresponding  subjective  estimates  were 
recorded  during  the  run.  Subjects  were  asked  to  give  their  estimate  of  fail- 
ure on  a scale  of  0 to  100  percent  immediately  following  randomly  selected 
intersections.  Nominally,  six  of  each  type  of  intersection  were  selected. 
Intersections  for  which  the  driver  received  a ticket  were  ignored.  (A  tacit 
assumption  in  using  subjective  estimates  received  after  the  execution  of  the 
signal  task  is  that  the  subjective  probabilities  were  unbiased  by  performance 
outcomes  as  perceived  by  the  subject.  To  test  this  assumption,  a parallel 
simulation  e:q)eriment  used  selected  intersections  where  the  visual  scene  was 
blanked  out  immediately  following  the  driver's  commitment  to  a decision  and 
prior  to  going  through  the  intersection.  Thus  the  driver  received  no  feedback 
on  his  performance  for  these  selected  intersections.  These  results  were  simi- 
lar to  the  "after  the  fact"  estimates.) 


BESUIffS 


The  data  were  examined  for  each  intersection  independently  over  the  eight 
trial  conditions  (four  trials  per  session  for  placebo  and  alcohol  sessions). 
Both  objective  and  subjective  data  were  analyzed  to  differentiate  between 
changes  in  risk  acceptance  vs.  risk  perception. 

In  Figure  5 the  objective  probabilities  of  going,  P(G),  and  failing 
given  a go,  P(F/G),  for  both  the  simulation  and  field  test  are  conpared  to 
determine  driver  risk-taking  behavior.  The  probabilities  were  conputed  by 
dividing  the  total  number  of  outcomes  by  the  total  number  of  opportunities 
(e.g.,  P(F/G)  = Number  of  go  failures dumber  of  go's).  For  example.  Inter- 
section 2 in  the  simulation  resulted  in  the  subjects  always  going,  P(G)  =1, 
and  the  timing  was  such  as  to  preclude  go  failures,  P(F/G)  =0.  The  timing  was 
aj-so  adequate  on  Intersection  5 to  allow  safe  go's;  however,  in  this  case  the 
drivers  did  not  always  go,  i.e.,  P(G)  = O.75,  This  behavior  was  not  sensi- 
tive to  alcohol,  and  the  subjects  appear  to  have  been  behaving  conservatively 
on  Intersection  5.  Subjects  did  not  go  very  frequently  on  Intersection  k and 
had  a high  failure  rate  when  they  did.  There  is  an  indication  of  increased 
go  behavior  under  alcohol  for  Intersection  U,  This  is  also  apparent  for  all 
the  intersections  in  the  field  test. 

Part. of  the  reason  for  this  increased  going  behavior  on  some  intersection 
timing  in  spite  of  increased  failures  is  illustrated  in  Figure  4.  Here  we 
note  that  the  variability  of  the  subjective  risk  perception,  cgp,  increases 
although  the  average  perception  of  risk,  SP(F/g),  remains  relatively  constant. 
Considering  a typical  switching  criterion,  as  shown  in  Figure  4,  we  see  that 
the  increased  variability  of  risk  perception  with  increased  alcohol  leads  to 
a greater  percentage  of  subjective  estimates  below  this  criterion.  The  justi- 
fication for  this  interpretation  was  validated  via  statistical  analysis  of 
parameters  for  the  proposed  model. 
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o)  SIMULATION  DATA 


D)  FIELD  TEST  DATA 


Figure  3.  Alcohol  Effects  on  Signal  Light  Risk-Taking  Behavior 


Plocebo  Trial  12  3 4 

Alcohol  Trial  Sober  Ascending  Peak  Descending 


Figure  h.  Changes  in  Subjective  Estimates  of  the  Probability 
of  Failure  Given  a Go  Attempt,  SP(F/G)  with  BAG  Condition 


MODEL  wrAumim 


The  decision-making  model  discussed  above  was  used  to  analyze  driver  risk 
acceptance  behavior.  This  was  accomplished  in  three  steps.  First,  driver 
risk  acceptance  thresholds,  SPq(f/G),  were  computed  for  each  experimental 
treatment.  Then  the  threshold  data  were  analyzed  to  investigate  changes  under 
intoxication.  Finally,  the  various  risk  perception  data  were  combined  accord- 
ing to  Eq,  5 atid  resulting  computed  or  estimated  values  of  the  probability  of 
going,  P(G),  were  compared  with  actual  P(G)  data  to  establish  model  validity. 

Risk  acceptance  thresholds  were  conputed  for  each  subject  and  each  run 
by  curve  fitting  a risk  acceptance  function  (Figure  5)  to  P(G)  and  SP(F/G) 
data  for  the  three  intersection  timing  conditions,  A trigonometric  function 
was  used  to  describe  the  risk  acceptance  function: 

P(G)  = 1 + c - SPc(F/G)]  (6) 
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Figure  5.  Alcohol  Effects  on  Signal  Light  Decision  Making  Behavior 


By  rearranging  this  formula  we  obtain  a relationship  which  can  be  used  for 
a linear  regression  fit; 


aSPi(P/G)  - aSPQ(p/G)  = sin“’ [2Pi(G)  - 1 ] (7) 

The  data  input  for  this  regression  fit  is  the  mean  subjective  probability  of 
failure  and  probability  of  going  for  each  intersection.  The  derived  values 
are  then  a and  the  risk  acceptance  threshold  SPq(p/g).  The  parameter  a des- 
cribes the  slope  at  the  midpoint  of  the  risk  acceptance  and  is  inversely  pro- 
portional to  the  risk  perception  variability  Ogp, 

The  SP(j(p/g)  were  con5>uted  and  analyzed  with  no  indication  of  alcohol 
effects  on  driver  risk  acceptance.  The  SPq  and  SP(P/G)  data  were  then  used 
to  cotapute  probability  of  go  estimates,  ^(G),  according  to  Eq.  5,  These 
conpare  favorably  as  shown  in  Pigure  6.  Analysis  of  covariance  procedures 
were  employed  to  conpare  the  actual  and  estimated  values  of  P(G),  The  P 
ratios  indicated  that  P(G)  was  highly  correlated  with  the  conputed  estimate 
^(G),  Reference  6, 

These  results  suggest  that  the  alcohol  effects  on  the  drivers*  subjective 
risk  perception,  both  SP(F/G)  and  cgp,  are  responsible  for  drivers  increased 
going  behavior  while  intoxicated.  They  also  validate  the  usefulness  of  the 
model  in  analyzing  that  behavior. 

There  are  other  possible  interpretations  of  these  results.  An  intuitive 
one  is  that  the  variations  in  subjective  estimates  are  due  to  variations  in 
the  time  of  the  decision  and  not  to  variations  in  perception  for  a given  time 
and  distance  relation.  However,  a preliminary  analysis  of  the  time  histories 
for  several  of  the  subjects  indicated  that  the  response  times  did  not  change 
significantly  under  alcohol.  Reference  7»  In  addition,  there  are  other  models 
which  could  be  applied  to  the  observed  signal  light  behavior.  A potentially 
fruitful  approach  is  the  signal  detection  model  as  developed  by  Green  and  Swets, 
Reference  8,  expanded  for  application  to  man/vehicle  problems  by  Curry,  et  al,. 
Reference  9>  ^nd  applied  to  the  lane  change  maneuver  by  Cohen  and  Ferrell, 
Reference  10,  Other  types  of  criteria  suggested  in  this  work,  such  as  likeli- 
hood ratio  threshold  and  Newman-Pearson  strategy,  may  be  applicable.  However, 
it  is  apparent  from  Pigure  6 that  the  additional  refining  assumptions  used  in 
these  models  may  not  be  necessary  for  interpreting  the  major  effects  of  alcohol 
on  decision  behavior. 


PREVIOUS  RESEARCH 


Vihile  increasing  frequency  of  driving  decision  errors  with  increased 
BAG  has  been  found  by  other  researchers,  the  interpretation  of  which  behavior 
component  is  primarily  responsible  for  this  increase  has  been  inconsistent. 
Comparison  between  studies  is  confounded  because  of  differences  in  tasks, 
reward  and  penalty  conditions,  alcohol  treatment  methods,  and  analytical 
approaches.  However,  the  results  can  be  interpreted  and  compared  as  follows. 
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Computed  P(6) 


Actual  P(6) 


Actual  P(6) 


Figure  6»  Coniparison  of  Measured  Versus  Confuted  Probability  of  Going.  P(G)  Estimates 
Confuted  Using  tfeasured  Values  of  SP(F/G),  <Jsp>  SPc(F/G) 


In  agreement  with  our  results,  four  of  the  five  other  studies  commented 
on  here  found  increased  risk  taking  with  increased  alcohol  intake.  Cohen, 
Dearnaley,  and  Hansel,  Reference  1,  in  evaluating  bus  drivers'  willingness  to 
drive  through  a cone -delineated  gap  found  the  number  of  attempts  increased 
with  alcohol  intake.  Lewis  and  Sarlanis,  Reference  11,  using  a simulated  traf- 
fic signal,  found  the  number  of  go  responses  significantly  increased  under 
alcohol.  Light  and  Keiper,  Reference  12,  also  found  an  increased  number  of 
atten^jted  passes  in  a simulated  overtaking  and  passing  task,  Finally,  Elling- 
stad,  McFarling,  and  Struckman,  Reference  15,  in  evaluating  performance  on 
laboratory  analogs  of  automotive  passing  tasks  with  multiple  discriminant 
analysis,  found  the  discriminant  "riskiness/indecisiveness”  increased  with 
alcohol.  This  discriminant  included  a positive  loading  on  passing  attenqpts. 

The  only  exception  to  this  trend  was  presented  ly  Snapper  and  Edwards,  Refer- 
ence 2,  who  found  no  significant  change  with  BA.C  in  the  number  of  attempted 
lane  changes  through  a given  gap  size  on  their  closed  course. 

The  interpretation  of  these  data  as  resulting  from  changes  in  psychcsnotor 
skill,  perceptual  ability,  or  cognitive  risk  acceptance  varies  between  authors. 
Re-analysis  is  difficult  because  only  two  of  these  studies  took  sufficient 
measures  to  delineate  changes  in  decision  strategies.  Cohen,  et  al. , Refer- 
ence 1,  asked  the  bus  drivers  to  indicate  levels  of  confidence  expressed  as 
the  number  of  times  out  of  five  the  driver  thought  he  could  succeed  in  driving 
through  the  different  size  gaps.  The  estimates  did  not  change  significantly 
on  the  average  for  the  narrowest  accepted  gap;  however,  the  accepted  gap  size 
decreased  with  increased  alcohol  Intake.  Therefore,  he  assumed  "If  the  diffi- 
culty of  the  task  remained  unchanged,  they  became  more  optimistic  and  attached 
a higher  subjective  probability  to  the  task.”  The  variances  in  the  estimates 
were  not  reported,  Cohen  concluded  that  the  primary  effects  of  alcohol  were 
to  decrease  psychomotor  skill  and  deteriorate  "judgment,”  where  we  interpret 
judgment  to  include  mean  perception.  Snapper  and  Edwards,  on  the  other  hand, 
asked  their  subjects  for  subjective  probabilities  and  found  no  significant 
change  in  the  mean  for  a given  gap  size.  As  they  found  no  change  in  the  mean 
subjective  estimates  and  no  increased  risk  taking,  but  with  increased  failures 
in  execution,  they  concluded  that  the  primary  effect  of  increasing  BAC  was 
degraded  psychoraotor  skill.  Again,  no  data  on  the  effects  of  BAC  on  the  consis- 
tency or  variability  of  the  subjective  probabilities  were  presented. 

By  conqparison,  our  findings  agree  with  most  of  these  results  but  not  with 
the  authors*  interpretations.  As  in  most  of  these  studies,  we  found  increased 
risk  taking  and  no  change  in  risk  acceptance,  i.e.,  no  change  in  the  mean  sub- 
jective estimate  for  a given  intersection.  However,  our  data  suggest  that 
Increased  risk  taking  is  primarily  due  to  increased  variance  or  inconsistency 
in  perceptual  estimates.  This  interpretation  could  also  explain  the  results 
found  by  the  first  four  authors  mentioned  above  if  data  on  mean  and  variances 
of  subjective  estimates  were  available.  The  disparity  between  this  conclusion 
and  Snapper  and  Edwards'  conclusion  may  be  due  to  at  least  two  factors.  Their 
lane  change  task  placed  more  emphasis  on  psychomotor  execution  than  does  the 
current  signal  light  task;  hence  their  results  may  have  been  more  sensitive 
to  this  type  of  degradation.  In  fact,  we  found  considerable  degradation  in 
the  consistency  of  psychomotor  performance  In  the  other  tusks  in  our  driving 
scenario  (Reference  7).  In  addition,  a fundamental  difference  between  our 
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simulated  driving  tasks  and  those  of  both  of  the  previous  studies  using  sub- 
jective estimates  is  addition  of  temporal  pressure.  Our  subjects  were  required 
to  form  their  estimates  in  "real  time"  as  opposed  to  the  "stop  action"  type  of 
judgments  and  driving  scenarios  used  in  previous  studies. 

Thus,  the  behavior  skills  required  for  the  decision-making  tasks  of  the 
other  researchers  are  somewhat  different  from  those  studied  here.  Allowing 
i’r these  differences,  the  other  studies  may  have  had  the  same  cause  for  the 
increased  risk  taking  as  measured  here,  namely,  distoirted  perception,  but  they 
did  not  present  sufficient  data  to  determine  it. 

In  summary  of  previous  decision-making  studies,  those  aspects  of  our 
results  which  are  directly  canparable  with  previous  research  largely  agree 
with  those  findings.  Risk  taking  generally  increased  with  increasing  BAG, 
Interpretation  of  previous  work  beyond  this  point  is  difficult  because  of 
insufficient  measures.  However,  that  work  does  not  disagree  with  the  current 
conclusion  that  thei  e is  no  change  in  risk  acceptance.  Our  interpretation 
of  these  results,  that  perceptual  distortion  is  a primary  cause  of  alcohol- 
induced  increased  risk  taking  observed  for  slRq>le  tasks,  is  new. 


CORCZiUSIORS 


An  expected  value  model  accounted  for  the  effects  of  perceptual  noise 
on  decisions  for  drivers  in  a simulated  signal  light  task.  With  this  mod  , 
analysis  of  the  significant  changes  in  behavior  for  increasing  BAG  indicaced 
no  changes  in  risk  acceptance;  that  is,  subjects  did  not  change  their  subjec- 
tive criterion  level.  The  primary  cause  of  the  increased  risk  taking  found 
for  intersections  timed  with  a low  probability  of  success  was  increased  incon- 
sistency or  variance  in  their  subjective  perceptual  estimates. 

These  results  have  ramifications  both  for  researchers  in  this  field  and 
those  attempting  to  apply  the  results.  In  future  human  decision-making  work, 
measures  of  inconsistency  in  perception  should  be  given  as  much  attention  as 
measures  of  central  tendency.  Also  suggested  by  these  results  is  that  one 
method  of  reducing  drinking  driver  errors  may  be  to  improve  the  driver's  per- 
ceptual environment  to  decrease  his  inconsistency.  We  could  expect  these 
results  to  generalize  the  effects  of  alcohol  on  other  such  real-time  decision 
tasks  as  aircraft  and  spacecraft  control.  In  addition,  the  analytical  frame- 
work used  here  may  be  useful  in  evaluating  the  effects  of  other  drugs  and 
stressors  on  human  decision  behavior. 
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SUMMARY 

This  paper  reports  on  the  ongoing  efforts  to  model  the  human  operator  in 
the  context  of  the  task  during  the  enroute/return  phases  in  the  ground  based 
control  of  multiple  flights  of  remotely  piloted  vahicles  (RPV).  This  is  a part 
of  our  research  aimed  at  investigating  human  performance  models  and  at  modeling 
command  and  control  systems.* 

The  approach  employed  here  uses  models  that  have  their  analytical  bases  in 
control  theory  and  in  statistical  estimation  and  decision  theory.  In 
particular,  it  draws  heavily  on  the  models  and  the  concepts  of  the  optimal 
control  model  (OCM)  of  the  human  operator.  We  are  in  ihe  process  of  extending 
the  OCM  into  a combined  monitoring,  decision,  and  control  model  (DEMON)  of  the 
human  operator  by  infusing  Decision  theoretic  notions  that  make  it  suitable  for 
application  to  problems  in  which  human  control  actions  are  infrequent  and  in 
which  monitoring  and  decision-making  are  the  operator's  main  activities.  Some 
results  obtained  with  a specialized  version  of  DEMON  for  the  RPV  control  problem 
are  included. 

1.  INTRODUCTION 


1.1  Modeling  Goals 

We  are  involved  in  a program  of  research  aimed  at  investigating  human 
oerformance  models  and  approaches  to  modeling  command  and  control  systems  (see 
reference  1 ) . A part  of  our  research  effort  concerns  the  study  of  the 
feasibility  of  modeling  the  human  operators  in  command  and  control  systems  via 
control  and  decision  theoretic  models.  This  paper  describes  the  salient  aspects 
of  this  part  of  our  ongoing  research  effort. 


1.2  Modeling  Approach 

The  approach  employed  here  uses  models  that  have  their  analytical  bases  in 
control  theory  and  in  statistical  estimation  and  decision  theory.  In 
particular,  it  draws  heavily  on  the  models  and  concepts  of  the  OCM  (references 
2-6).  The  modeling  approach  is  normative,  in  that  one  determines  what  the  human 
operator  ought  to  do,  given  the  system  objectives  and  the  operator's 


• The  research  reported  in  this  paper  was  supported  by  the  Air  Force  Office  of 
Scientific  Research  under  contract  F44620-76-C-0029. 
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limitations,  and  this  serves  as  a prediction  of  what  well-trained,  motivated 
operators  will  do. 

In  the  basic  OCM  concern  is  more  with  the  operator’s  continuous  interact.  i 
with  the  system,  as  demanded  by  closed  loop  analysis,  than  with  his  response  to 
discrete  events.  The  development  of  the  basic  OCM  and  its  model  structure  has 
been  dictated  by  the  principal  areas  of  its  previous  application,  viz.,  vehicle 
control.  We  shall  extend  the  OCM  by  incorporating  structures  and  notions  that 
make  it  suitable  for  application  to  problems  in  which  human  control  actions  are 
infrequent  and  in  which  monitoring  and  decision-making  are  the  operator's  main 
activities.*  The  expected  end  product  is  a combined  monitoring,  decision,  and 
control  model  for  the  human  operator  in  a command  and  control  task. 


1.-3  Task  definition 

In  this  paper  we  shall  discuss  our  modeling  effort  as  it  relates  to  the 
task  facing  the  human  operator  during  the  enroute/return  phases  in  the  ground 
based  control  of  multiple  flights  of  remotely  piloted  vehicles  (RPV). 

The  enroute/return  phases  together  with  a terminal  control  phase 
constitute  an  "RPV  mission".  An  RPV -mission  consists  of  coordinated  flights  of 
several  RPV-triads.  Each  triad  has  a strike  vehicle  (S),  an  electronics 
countermeasures  vehicle  (E)  and  a low-  reconnalsance  vehicle  (L).  Each  RPV  is 
automatically  controlled  along  a pre-programmed  flight  plan  assumed  optimal 
with  respect  to  terrain  and  defenses.  The  RPVs  deviate  from  their  flight  plan 
due  to  navigation  system  errors,  position  reporting  errors,  communication 
Jamming  by  the  enemy,  equipment  malfunctions  etc.  These  deviations  are  kept  in 
check  by  external  monitoring  and  control  from  the  ground  station.  This 
supervision  is  provided  by  human  enroute  controllers,  who  are  equipped  with  CRT 
displays  for  monitoring  flight  path  and  vehicle  status  and  with  keyboards  and 
light  pens  for  Introducing  changes  in  RPV  flight  parameters.  The  ultimate 
objective  of  the  enroute  controllers  is  to  ensure  that  the  S and  E RPVs  fly  on 
schedule  over  the  target  15  seconds  apart  followed  by  the  L RPV  two  minutes 
later  to  assess  damage.  This  time-phasing  at  the  target  is  accomplished  by 
time-phased  handoffs  at  designated  hand-off  coordinates  on  the  flight  plan.  The 
S RPVs  are  handed  off  to  the  terminal  controller  (pilot)  equipped  with  a 
televised  view  from  the  nose  of  the  RPV  and  with  standard  aircraft  controls  and 
displays  in  order  to  direct  each  vehicle  to  a specific  designated  target, 
release  its  payload,  and  hand  it  back  to  one  of  the  enroute  controllers. 

Terminal  phase  control  is  achieved  only  if  the  S RPV  is  within  a 1500* 
corridor  around  its  flight  plan.  It  is  the  responsibility  of  the  enroute 
operator  to  command  "patches"  to  alter  the  flight  plan  as  necessary  to  achieve 
terminal  phase  control.  These  patches  are  acceptable  ("GO")  only  if  they 
satisfy  constraints  such  as  turning  radius,  available  fuel,  command  link  status 
etc. 


* This  type  of  extension  is  feasible  because  of  the  basic  Information  processing 
structure  of  the  OCM.  Indeed,  there  have  already  been  applications  of  OCM  to 
account  for  visual  scannlng( references  7,8)  and  decision  making( references 
9,10). 
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In  summary,  the  enroute  operator's  task  is  to  monitor  the  trajectories  and 
ETAs  of  N vehicles,  to  decide  if  the  lateral  deviation  or  ETA  error  of  any  of 
these  exceeds  some  threshold,  and  to  correct  the  paths  of  those  that  deviate 
excessively  by  issuing  acceptable  patches. 


2.  THE  aOSBD  LOOP  MODEL 

A block  diagram  modeling  the  flow  of  information  and  the  control  and 
decisions  encountered  by  the  human  operator  (enroute  operator)  is  shown  in 
Figure  1. 

ORIGINAL  PAGE  IS 
OF  POOR  QUALITY 


Figure  1.  Block  Diagram  for  RPV  Monitoring/Control  Decision  Problem 

DCF;  The  DCF  (Drone  control  facility)  contains  the  stored  flight  plans 
that  drive  the  N subsystems  RPVj^,  1=1, 2,..., N.  They  are  usually  "optimal"  with 
respect  to  current  terrain  and  other  information.  We  will  assume  they  can  be 
computed  using  state- variable  equations. 

System:  The  N RPVs  undergoing  monitoring/control  constitute  the  system.  A 
simple  non-lineai-  representation  of  their  dynamic  behavior  will  be  assumed  for 
this  analysis.  Linearization  will  be  carried  out  if  necessary  for 
implementation  of  the  model.  The  true  status  x^  of  the  i-th  RPV  may  be 
different  from  the  stored  flight  plans  due  to  "disturbances"  w^.  The  reported 
status  y^  will  be  different  from  the  true  status  due  to  reporting  erre*-  vi. 
The  observed  status  will  depend  on  the  reported  status  y*  and  on  tine 
"monitoring  strategy"  (to  be  discussed  later  on). The  disturbances  w^  and 
reporting  error  v^  will  be  modeled  by  suitable  random  processes.  The  y^  are  the 
displayed  variables  corresponding  to  RPVji, 
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Monitoring  Strategy:  Since  the  human  must  decide  which  RPV  or  which 
display  to  look  at,  he  needs  to  develop  a monitoring  strategy.  This  is 
important  because  his  estimates  of  the  true  status  of  each  RPV  (and  hence  his 
patch  decision  strategy)  will  depend  upon  his  monitoring  strategy.  To  account 
for  the  interaction  of  the  patch  decision  strategy  with  the  monitoring  strategy 
we  formulate  and  solve  a combined  monitoring  and  patching  decision  problem 
(Appendix  B has  the  details). 

Monitoring  strategies  may  be  distinguished  by  whether  they  predict 
temporal  (time  histories  of)  monitoring  behaviour  or  average  monitoring 
behaviour  over  some  chosen  time  horizon.  Most  of  the  earlier  work  in  the 
literature,  including  that  with  the  OCM,  falls  in  the  latter  category.  The 
monitoring  strategy  we  derive  will  predict  temporal  behaviour  which  can  be 
simulated  , Some  of  the  monitoring  strategies  derived  in  the  literature  which 
we  expect  to  investigate  in  the  DEMON  setup  are: 

(i)  A simple  strategy  involving  cyclical  processing  of  the  various 
RPVs( reference  11), 

(ii)  A strategy  generalizing  the  Queueing  Theory  Sampling  Hcdel  (reference 
12),  which  would  minimize  the  total  cost  of  not  looking  at  a particular  RPV 
at  a given  time.  This  strategy  is  mainly  useful  for  maintaining  lateral 
deviations  within  allowable  limits.  The  costs  for  errors  and  for  the 
different  RPVs  would  be  functions  of  the  time-to-go  and,  possibly,  RPV 
type. 

(ill)  A strategy  of  sampling  when  the  probability  that  the  signal  exceeds 
some  prescribed  limit  is  greater  than  a subjective  probability 
threshold  (references  13,1*J). 

(iv)  A strategy  aimed  at  minimizing  total  estimation  error (reference  7). 
This  strategy  would  be  consistent  with  monitoring  for  the  purpose  of 
minimizing  lateral  deviation  errors. 

Information  Processor:  This  block  models  the  processing  that  goes  on  in 
the  human  operator  to  produce  the  current  estimate  of  the  true  RPV  status  from 
past  observed  status.  This  block  is  the  well  known  control-  theoretic  model 
consisting  of  a Kalman  filter-predictor  which  produces  the  maximum-likelihood, 
least-squares  estimate  x =(x^,  x^,,.,,  x**)  of  the  true  status  x of  all  the 
RPVs.  It  also  produces  the  variance  of  the  error  in  that  estimate.  (Note  that  an 
estimate  of  the  state  of  each  RPV  is  maintained  synchronously  at  all  times. 
Observation  of  a particular  RPV  improves  the  accuracy  of  the  estimate  of  the 
status  of  that  RPV  while  uncertainty  about  the  status  of  the  remaining, 
unobserved  vehicles  increases.)  Given  the  assumptions  generally  made  for  this 
kind  of  analysis,  the  information  processor  can  thus  generate  the  conditional 
density  of  x based  on  the  past  observations  y. 

Decision  Strategy:  This  block  models  the  process  of  deciding  which,  if 
any,  RPV  to  patch.  Ne  consider  the  decision  process  to  be  discrete  (it  takes  5 
sec  to  get  a new  display).  The  cost  of  making  a patch  would  reflect  the  lost 
opportunity  to  monitor  and/or  patch  other  RPVs  as  well  as  breaking 
radio-silence;  the  gain  (negative  cost)  is  the  presumed  reduction  in  error  for 
the  "patched"  vehicle.  The  decision  strategy  attempts  to  minimize  the 
(expected)  cost.  This  block  translates  the  best  estimate  x '<nto  a decision  to 
(1)  command  a patch  to  one  of  the  RPVs  and/or  (11)  modify  the  future  monitoring 
strategy. 
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Patch  Comand  Generator:  This  block  generates  the  commanded  patch.  We 

shall  investigate  a strategy  based  on  minimizing  a weighted  sum  of  the  time  to 
return  to  the  desired  path  and  the  total  mean-square  tracking  error.  The 
allowable  paths  would  be  constrained  by  the  RPV  turning  radius  limits.  Random 
execution  errors  would  be  added  to  the  commanded  patch  to  represent  human 
errors . 

Patch  Check:  This  consists  of  a GO/NO  GO  check  on  the  patch  using 

conditions  on  turning  radius,  coironand  link  status,  etc. 

3.  HATHEMATICAL  DETAILS  OP  THE  MODEL 

3.1  System 

The  system  under  study  consists  of  the  N-RPV  subsystems  and  may  be 
described  by  the  state  equations:* 

s Ax  + dBu  +Ew  +Fz  ,x(tQ)  = xq  (1) 

where  the  state  vector  x includes  the  states  x^  of  the  N-RPV  subsystems.  Here  d 
is  a vector  of  decision  variables  (to  be  explainad  below)  and  z is  a non-random 
input  vector  which  will  be  used  to  model  non-zero  means  of  the  random  inputs  w 
as  well  as  any  predetemined  command  inputs.  In  the  present  RPV  context  z will 
be  used  to  generate  the  flight  plan  for  the  RPVs.  The  vector  u denotes  the 
patch  control  input  to  the  RPVs.  In  partitioned  form  equation  (1)  appears  as 
follows : 
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For  the  system  under  study,  the  following  observations  hold: 

A1:  Only  one  of  the  N-RPV  subsystems  may  be  controlled  by  the 

patch-control  u at  any  given  time.  A decision  to  control  the  i-th  RPV  subsystem 
then  implies  the  following  conditions  on  the  decision  variables: 

di  r 1 , dj  s 0 , J i (3) 

A2:  The  N-RPV  subsystems  are  decoupled  (except  for  the  interdependence  of 

the  decision  variables  via  (3))»  that  is. 


* For  the  purpose  of  disoussi  '>n , a linear  model  is  assumed . In  actual 
implementation,  we  may  use  a simple  non-linear  model  in  which  case  (1)  would 
represent  a linear  perturbation  equation  for  the  system  about  some  nominal 
trajctory. 
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kU  = 0,  EiJ  = 0 , pij  = 0,  is^j 


(4) 


N-RPV  subsystems  may  thus  be  described  by 
ii  = All  x1  + djBlu  + eIIwI  + pUzl,  x1(to)  = xj 

(5a) 

di  = 0 or  1 

(5b) 

I di  = 1 or  0 

(5c) 

3.2  Flight  Plan  (DCF) 

When  there  is  no  disturbance  and  no  (patch)  control  u then  the  N-RPV 
subsystems  follow  the  flight  plan 

x^  +F^iz^,  x^(to)  = (6) 

Flight  plans  made  up  of  straight  lines  are  easily  generated  using  a piecewise 
constant  time  function  for  and  x^  as  the  launch  point. 


3.3  Patching 


Any  disturbance  w^  causes  the  i-th  RPV  to  deviate  from  its  flight  plan. 
Denoting  these  deviations  by  e^  = x^  - x^  it  follows  from  (5)  and  (6)  that 

s A^i  e^  + diB^u  + E^^w^  , e^(to)  = xj-xj  (7a) 


dj  s 0 or  1 

I dj^  = 1 or  0 


(7b) 

(7c) 


It  is  the  purpose  of  the  (patch)  control  u to  correct  any  such  deviation.  Since 
w^  is  an  unknown  random  disturbance  and  d^  is  nonzero  for  at  most  a single  RPV 
subsystem,  it  is  not  possible  to  maintain  e^=0  for  all  1.  The  operator  thus 
faces  the  patching  problem  which  consists  of  the  following  three  sub-problems: 

(i)  Monitoring  decision  - which  RPV  to  monitor? 

(ii)  Patching  decision  - whether  to  patch  the  monitored  RPV? 

(iii)  Patch  computation  - what  patch  command  to  issue? 


3.3.1  Monitoring  Decision 

As  mentioned  before,  the  monitoring  decision  is  intimately  connected  with 
the  patching  decision  because  it  restricts  the  available  patching  options.  For 
example,  in  the  present  RPV  context  only  a monitored  RPV  can  be  patched.  The 
combined  monitoring  and  patching  decision  problem  is  analyzed  in  appendix  B. 
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3* 3*2  Patching  Decision 


A patching  decision  consists  of  deciding  if  the  monitored  RPV  subsystem  is 
to  be  patched.  At  most  one  of  the  RPVs  may  be  patched  at  a given  time.  One 
idea  of  patching  is  to  reduce  deviations  from  the  flight  plan  to  below  some 
threshold  values.  Some  facts  to  note  are: 

(i)  Cross- track  error  of  less  than  250*  is  desired  for  type-S  RPVs 
(ii)  Terminal-phase  control  not  possible  if  cross  track  error  exceeds  1500' 
We  assume  a normative  model,  in  which  the  operator  attempts  to  optimize  some 
(subjective)  measure  of  performance  via  a patching  decision.  This  performance 
measure  would  depend  on  his  understanding  of  the  mission  objectives.  Some  of  the 
objectives  of  the  RPV  mission  are:  Don't  lose  an  RPV,  maintain  ETA,  maintain 
lateral  position,  maintain  radio  silence.  We  consider  two  alternative  cost 
functions  to  help  in  arriving  at  a patching  decision: 

Piecewise  constant  cost  function 

C(e^)  = if  e e^,  a threshold  set 

C(ei)  = Ci  if  ei  ^ e^ 

Quadratic  Cost  function 

C(e^)  = e^'  K e^ 

The  choice  of  e|  and  K will  be  made  based  on  facts  of  the  type  (i)  and  (ii) 
noted  above.  The  costs  C^,  C^,  C(e^)  will  be  chosen  to  be  functions  of  mission 
time  to  reflect  the  Importance  of  ETA.  As  mission  time  gets  closer  to  ETA  for 
RPV-i,  will  be  made  larger  and/or  e^  will  be  shrunk  to  reflect  "urgency". 
The  optimal  patch  decision  will  be  chosen  to  minimize  the  expected  cost  using 
subjective  probabilities  computed  with  the  help  of  the  information  processor. 
The  details  are  in  Appendix  B. 

3.3«3  Patch  Control  Computation  and  Generation 

Once  a decision  is  made  tc  patch  a particular  RPV-subsystem,  it  is 

necessary  to  compute  and  execute  the  patch  control.  The  purpose  of  a patch 

control  is  to  guide  the  aircraft  from  its  initial  location  and  heading  to 

Intercept  and  fly  along  the  planned  flight  path.  Various  criteria  may  be 

considered  to  compute  the  optimal  patch  control,  for  example,  a strategy  that 
minimizes  the  time  to  return  to  the  planned  flight  path  (see  appendix  A and  also 
reference  15). 


H,  IHPLEHBNTATIOM  OF  THE  HODBL 

DEMON,  the  combined  monitoring,  decision,  and  control  model  of  the  human 
operator  is  being  implemented  in  FORTRAN.  The  program  ha^  a modular  structure 
to  facilitate  ease  of  adding  further  modules  to  include  alternative  monitoring, 
control,  and  decision  strategies  that  may  appear  promising  at  a future  date. 

To  accomodate  the  random  aspects  of  the  problem,  the  program  will  basically 
have  a Monte-Carlo  simulation  character.  The  specialized  version  of  DEMON  for 
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the  BPV  problem  will  produce  as  outputs  the  "true”  time>hlstories  of  the  RPV 
flights,  the  sequence  of  monitoring  and  patching  decisions  made,  and  the 
resulting  performance. 

The  important  aspects  of  the  simulation  program  implementing  Demon  are 


Figure  2.  Flow  Diagram  for  the  simulation  program  implementing  DEMON 

shown  in  the  flow  diagram  in  rigure  2.  There  are,  as  indicated,  nine  major 
modules  in  the  program.  Modules  4,  6 and  7 are  of  speolal  interest  beoause  they 
d<  not  arise  in  the  usual  manual  control  models.  The  theory  behind  these 
modules  is  developed  in  Appendices  A and  B.  As  indicated  in  Appendix  A,  the 
patch  command  generator  could  involve  a non*linear  control  law, 

5,  BZAMPLB 

In  order  to  test  some  of  the  modeling  oonoepts  and  to  debug  the  DIMON 
program  we  consider  a simple  example  which  captures  the  easenoe  of  the  RPV 
mission  while  discarding  the  nitty  gritty  details.  The  lateral  motion  of  the 
RPVs  about  their  flight  plan  is  represented  by  random  walk  prooasaes  over  the 
assumed  mission  duration  of  600  frases  (the  display  frame  update  rate  is  every  5 
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seconds) . Each  RPV  is  observed  via  a single  lateral  deviation  display  and 
controlled  via  a constant  velocity  comand.  The  permissible  patch  back  to  the 
flight  plan  is  constrained  by  the  maximum  allowable  speed  which  represents  the 
turning  radius  constraint.  The  patch  control  strategy  is  to  use  maximum 
allowable  speed  adjusted  by  a "safety  factor"  tdiich  depends  on  the  "NO  GO" 
patches  issued  previously  by  the  operator  for  that  RPV. 

Some  preliminary  results  have  been  obtained  using  DEMON  on  the  above 
simplified  RPV  mission.  The  flavour  of  the  results  we  obtained  is  indicated  in 
Figure  3 which  shows  the  combined  effect  of  ETA  dependent  (shrinking)  threshold 
and  different  RPV  priority  on  the  simulated  simple  RPV  mission.  As  mission  time 
Increases  RPV  monitoring  frequency  increases  . But  there  comes  a time  when 
monitoring  resources  are  not  adequate  to  satisfy  the  increasing  needs  of  each  of 


Figure  3.  Effect  of  Shrinking  Threshold  and  RPV  Priority 

the  RPVs  and  then  the  highest  priority  RPV  demands  most  of  the  attention  it  can 
get  while  the  lowest  priority  RPV  gets  no  attention  from  the  operator. 

6.  CONCLUSION 

He  have  developed  DEMON,  a combined  monitoring,  decision  and  control  model 
for  the  human  operator  in  the  context  of  the  enroute  phase  of  an  RPV  mission. 
Since  the  monitoring  strategy  derived  from  DEMON  is  temporal  it  has  obvious 
application  to  developing  instrument  scanning  strategy  for  flight  control  and 
management.  He  have  structured  the  model  to  have  wider  applicability  (than  the 
problems  addressed  by  the  basic  OCM  or  the  RPV  control  problem)  and  expect  it  to 
be  useful  to  model  human  operators  whose  control  actions  may  be  infrequent  but 
whose  monitoring  and  deoison  making  may  be  the  primary  activities.  He 
ontlcipate  testing  and  refining  the  DEMON  model  furthur  using  an  existing  data 
base  for  the  RPV  control  problem( reference  16). 
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7.  APPEHDIX  A:  PATCH  CONTROL  STRATBGI 

7«1  S]^ten  l)yiiaBic8  and  Patch  Coaputation 

In  Section  3i  the  N-RPV  system  dynamics  were  considered  in  general  terms. 
Here,  we  shall  use  a simple  model  for  the  RPV-subsystem  dynamics  and  derive  a 
specific  patch  control  strategy.  Considering  only  the  projected  motion  in  the 
horizontal  plane  we  shall  re-write  the  normalized  equations  of  motion  derived  in 


Figure  4.  Choice  of  Co-ordinates  for  System  Equation 

reference  15,  using  the  state  variables (see  Figure  4}  xi  s ground-speed  error, 
X2  - cross-track  error,  X3  s velocity  component  along  track,  X4  s heading 
relative  to  track: 

= cos  X4  - 1 , xi(0)  given,  x-jd)  free 

= sin  X4  , X2(0)  given,  X2<T)  =0 

A3  su  sin  X4  , X3(0)  given,  X3(T)  si 

A4  s-u  , X4<0)  given,  X4(T)  sO 

T free 
x|  x^  s 1 

Once  a decision  is  made  to  patch  a particular  RPV-subsystem,  it  is 
necessary  to  compute  and  execute  the  patch  control.  The  purpose  of  a patch 
control  is  to  guide  the  aircraft  from  its  initial  location  and  heading  to 
intercept  and  fly  along  the  planned  flight  path.  Various  criteria  may  be 
considered  to  compute  the  optimal  patch  control.  Many  criteria  may  be  written 
in  the  form,  _ » 

J s 1/2Kixf(T)  ♦ I/2K2  J xf  dt  + K3  dt 

which  is  a weighted  sum  of  the  square  of  the  ground  speed  error,  integral  square 
of  the  cross-track  deviation,  and  time  to  return  to  the  planned  flight  path. We 
shall  only  solve  the  special  problem  of  minimum  time  to  return  to  the  flight 
path  by  choosing  the  weights  to  be  K^s0sK2  and  K3SI. 
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7«2  Miniaua  Tiae  Patch  Strategy 

Using  the  necesssary  conditions  for  minimum  time  it  is  easy  to  see  that  the 
optimal  control  is  Bang-Bang  except  for  possible  singular  arcs.  It  can  furthur 
be  shown  that  the  singular  control  is  Identically  zero. 


^Ufl  Tvra 


Figure  5.  Minimum  Time  Patch  Control  Strategy 

The  computed  minimum-time  patching  strategy  is  Indicated  in  Figure  5.  For 
example,  all  points  in  state  space  that  can  be  brought  to  the  planned  flight 
path  using  a single  left  tu>'n  usi  are  characterized  by  the  equation  X2(0)  s cos 
X4(0)-l  . 

The  minimum  time  required  for  the  patch  will  be  checked  against  the 
scheduled  hand-off  times  for  the  given  RPV  to  determine  if  the  computed  patch 
should  be  executed.  Velocity  patches  to  correct  for  ETA  errors  with  due  regard 
to  fuel  constraints  may  be  Included  by  a simple  extension  of  the  above  problem 
(for  example,  append  to  the  minimum  time  patch  a velocity  patch  to  minimize  ETA 
errors) , 

The  operator  does  not  observe  the  states  x directly,  and  will  base  his 
control  actions  instead  on  the  best  estimates  of  these  states  available  to  him 
based  on  all  his  observations.  This  disjoining  of  estimation  and  control  is 
Justified  by  the  “separation  principle"  (see  reference  17). 

8.  APPBNDIl  B:  PATCH  DBCISION  STRATBGT 

8. 1 Introduction 

In  this  appendix  we  shall  formulate  and  solve  the  combined  monitoring  and 
patching  deoison  problem  encountered  by  the  enroute  operator  in  the  RPV  mission. 
As  stated  in  section  3,  the  information  processor  produces  the  current  estimate 
x''  of  the  true  status  x of  all  the  RPVs  at  any  time.  It  also  produces  the 
variance  of  the  error  in  that  estimate.  The  information  available  for  making 
monitoring  and  patching  decisions  may  be  summarized  in  terms  of  the  posterior 
distribution  of  x^^  conditioned  on  all  observations  based  on  past  monitoring  and 
patching  decisions  and  control.  Under  the  usual  assumptions,  this  posterior 
distribution  for  xi  ia  N(xi,  X^I). 
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Let  denote  a threshold  set  associated  with  the  i-th  RPV,  that  is,  x^c 
is  a desirable  condition.  Let  denote  the  hypothesis  that  xM  x^  and 
be  the  probability  that  is  true.  P^  is  easily  calculated  using  the  available 
Information  on  the  posterior  distribution  of  x^: 

pi  = 1 - H(xl  , Xll)  dxl 

4 

^nitoring  the  i-th  RPV  results  in  a tighter  distribution  for  x^  around  its  mean 
xi  because  it  reduces  the  uncertainty  xH  associated  with  x^.  Patching  the  i-th 
RPV  requires  monitoring  as  well.  The  effects  of  patching  are:  first,  to 

correct  the  error  el  tdiioh  might  have  'wandered  off  from  zero  due  to 
disturbances,  by  assuring  that  xl  c x^;  and  second,  to  provide  a tighter 
distribution  of  xl  around  its  mean  xl. 

To  formulate  and  solve  the  combined  monitoring  and  patching  decision 
problem,  we  shall  assume  that  is  the  cost  if  r1  is  true.  Recall  that  rI  has 
a (subjective)  probability  plof  being  true.  Just  as  H^,  pl,  Cj  were  defined  in 
relation  to  the  set  x^,  let  Pl,  be  defined  in  relation  to  the  set  x^,  the 
complement  of  x^.  We  shall  use  minimum  expected  cost  EC(d*)  as  the  criterion 
for  selecting  the  best  monitoring  and  patching  decision  d*. 

Lot  d]^j  denote  a decision  to  monitor  RPV-i  and  patch  RPV-j  in  the  combined 
monitoring  and  patching  decision  problem.  Since  a patch  can  be  done  only  on  a 
monitored  RPV,  there  are  only  2N-f1  available  decisions.  They  are: 

(1)  Do  nothing  decision  dgoi  that  is,  monitor  no  RPV  and  patch  no  RPV.* 

(ii)  N pure  monitoring  (no  patching)  decisions  diQ,  jsl,2,..,N. 

(iii)  R patching  (and  monitoring)  decisions  djj,  jsl,2,...,N. 

Let  P^j|{  denote  the  probability  that  the  hypothesis  rI  is  true  when  the 
decision  is  dj|(.  Because  the  RPV  subsystems  are  non- interactive,  it  follows 
that  the  probabilities  associated  with  RPV-i  when  some  other  RPV  is  monitored 
and/or  patched  is  same  as  that  associated  with  RPV-i  when  no  RPV  is  monitored. 
That  is, 

**i00  * Pijk  *"y  1*1, 2,..., N;  ksj  or  0 

Thus,  there  are  only  3N  distinct  probabilities  to  be  computed 

(i)  N probabilities  P^^qq  associated  with  do-nothing  decision  dpQ 

(ii)  N probabilities  Pj^^Q  associated  with  pure  monitoring  decision  dj^o 

(iii) N  probabilities  Pij^i  associated  with  patching  decision  d^i 

Let  (PP)i  denote  the  probability  that  the  patch  decision  d^i  "takes",  that  is, 
results  in  x^  x^,  and  let  Tj^j  denote  the  cost  of  implementing  decision  dij. 
The  costs  Tjj  will  be  chosen  to  be  functions  of  mission  time  to  reflect  the 

importance  of  ETA.  As  mission  time  gets  closer  to  ETA  for  RPV-i,  Tj[j  will  be 

made  larger  and/or  x^  will  be  shrunk  to  reflect  "urgency". 


* This  could  correspond  to  performing  some  other  task  such  as  communication. 
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The  combined  monitoring  and  patching  decision  p'r'oblem  is  described  in  terms 
of  a decision-tree  diagram  in  Figure  5.*  The  ac,ual  cost  of  a particular 
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Figure  6.  Decision  Tree  Diagram  for  Combined  Monitoring  and  Patching 

decision  depends  on  the  path  chosen  to  traverse  the  tree  from  level  1 to  level 
5.  The  exact  path  from  level  1 to  level  5 for  the  N-BPVs  are  determined  both  by 
the  decision  maker  (the  human  operator)  and  by  Nature  (the  random  elements  in 
the  problem)  . Since  a decision  has  to  be  made  at  level  1 before  Nature  has 


* For  reasons  similar  to  the  one  we  stated  for  combining  the  monitoring  and 
patching  decision  problem i one  might  argue  that  the  decision  problem  over  the 
rest  of  the  mission  duration  must  be  considered  by  the  operator  at  any  decision 
instant  during  the  mission.  We  shall  not  do  this  because:  first,  the  analysis 
for  this  case  is  no  different  from  the  one  we  present  here  - only  the 
expressions  are  messier;  and  second,  the  actual  computations  of  the  decisions 
would  become  infeasible  . 
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taken  its  course  at  the  monitoring  level  3 and  at  the  patching  level  4 , the 
decision  maker  can  only  evaluate  his  2N-t-1  alternative  decisions  in  ten...?  of 
their  expected  costs.  This  he  can  do  as  follows:  The  expected  cost  of  the 

do-nothing  decision  doo 

EC(doo)  (Ci  Pioo  ♦ ^i  ^iOO^ 

Expected  cost  of  pure  monitoring  decision  djo  is 

EC(djo)  s EC(doo)-(CjPjOO+5jPjOO)+  CjPjjo+CjPjjoJ+  ^JO 

Expected  cost  of  a patching  decision  djj  is, 

EC(djo)  s EC(doo>-(CjPjoO+C,iPjOO>+(CjPjjj+CjPjjj>(PP  P Tj^) 

The  optimal  decision  d*  is  the  one  which  results  in  maximum  opportunity  gain, 
that  iSt* 

d*  s arg  min  ( BC(doo»  BC(dao)i  EC(di{i{)  ) 

where 

m s arg  maXj  ((CjPjoo+CjPjoo)-  (CjPjjo+CjPjjo)-  Tjo  > 

k a arg  maxj  ((CjPjoo-»^.jPjOO>+(CjPjjj+C^Pjjj)-(PPjPjjj:Cj-C^)-Tjj)  ) 

Consider  a specialization  of  the  above  decision  problem  where  the 
probabilities  are  assumed  to  be  independent  of  the  decisions  di)(  (that  is, 
^ijk  ' costs  and  T^^j  are  all  zero,  and  the  patch  success 

probabilities  (PP)|a1  for  each  subsystem  RPV.  Then  the  optimal  decision  is 

d*  a djj 

where 

J a arg  maxj  (Pj  Cj) 

This  is  the  result  obtained  by  CarbonelK reference  12). 

An  implicit  assumption  made  in  the  computation  of  expected  cost  in  the 
combined  monitoring  and  patching  decision  problem  is  that  the  costs  are  constant 
over  the  entire  se;.s  and  x^.  This  assumption  is  easily  dropped  when 
non-constant  cost  functions  are  desired,  e.g., 

C(e^)  a e^*  M e^ 

In  such  a case,  in  the  above  analysis  will  be  replaced  by  an  appropriate 

integral  which  would  yield  Pijic^i  ss  a function  of  x^  and  and  appears 
amenable  for  computations. 


• The  notation  arg.  min.  implies  d*adQo  or  d^o  or  dj{j{  depending  on  which  of  the 
three  values  ECCdorj),  BC(dg,o)i  EC(d|(|()  is  the  smallest.  Here  d^o  is  the  best 
monitorin?  decision  and  d)(|(  is  the  best  patching  decision. 
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We  close  this  appendix,  '.rith  an  example  of  a piecewise-constant  cost 
function  that  appears  meaningful  f-?r  the  N-RPV  system  under  study.  Recall  from 
appendix  A that  the  first  two  components  of  x^  are: 

x^  = ground  speed  error  (along  track) 

x^  s cross- track  error 

One  choice  for  the  piecewise-constant  cost  function  is : 

C(ei)  = 1 if  |x|l  > xjx  =250 

= 0 if  |x||  i 250 
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SUMMARY  , 


It  is  proposed  that  human  decisicn  making  in  many  multi-task  situations 
might  be  modeled  in  terms  of  the  manner  in  which  the  human  detects  events 
related  to  his  tasks  and  the  manner  in  which  he  allocates  his  attention  among 
his  tasks  once  he  feels  events  have  occurred.  A model  of  human  event 
detection  performance  in  such  a situatloi  is  presented.  An  assumption  of  the 
model  is  that,  in  attempting  to  detect  events,  the  human  generates  the 
probabilities  tiiat  events  have  occurred.  Discriminant  analysis  is  used  to 
model  the  human's  generation  of  these  probabilities.  An  experimental  study 
of  human  event  detection  performance  in  a multiple  process  monitoring 
situation  is  described  and  the  application  of  the  event  detection  model  to 
this  situation  is  addressed.  The  experimental  study  employed  a situation  in 
which  subjects  simultaneously  monitored  several  dynamic  processes  for  the 
occurrence  of  events  and  made  yes/no  decisions  on  the  presence  of  events  in 
each  process.  Input  to  the  event  detection  model  of  the  informatics! 
displayed  to  the  experimental  subjects  allows  oomparison  of  the  model's 
performance  with  the  performance  of  the  subjects. 


INTRODUCTION 


In  many  systems,  the  human  operator  spends  much  of  his  time  monitoring 
subsystems  for  events  which  call  for  action  on  his  part.  Aircraft,  power 
stations,  and  process  control  plants  are  examples  of  such  systems.  As  the 
complexity  of  these  systems  increases,  the  operator  becomes  responsible  for 
more  subsystems  of  greater  variety.  There  is  consequently  a greater 
probability  that  the  operator  will  encounter  situations  in  which  there  are 
more  tasks  than  he  can  acceptably  pmf'form. 

One  means  of  maintaining  the  operator's  workload  at  a satisfactory  level 
is  the  introduct  icxi  of  automaticxi  capable  of  performing  some  of  the 
operator's  tasks.  Models  of  the  operator's  task  performance  would  be  of  use 

*This  research  was  supported  by  the  National  Aeronautics  and  Space 
Administmtlcn  under  NASA-Ames  Grant  NSQ-2119. 
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'in  predicting  the  performance  gains  to  be  expected  frcro  the  introducti<si  of 
such  aids.  Further,  in  systems  in  which  the  responsibilities  for  some  tasks 
are  shared  by  the  operator  and  an  automated  decision  maker,  these  a»dels 
might  also  be  used  within  the  system  to  coordinate  the  actiais  of  ttie  two 
decisi^  makers. 

Senders  [1]  and  Smallwood  [2]  have  modeled  human  decision  making  in 
multiple  process  monitoring  tasks.  Senders  postulated  that  the  human  monitor 
samples  his  displays  in  a manner  which  allows  reconstruction  of  the  displayed 
signals.  An  information  theory-  approach  is  employed  to  determine  how  often 
and  for  what  duration  the  human  must  sample  each  display.  Smallwood  proposed 
that  the  human  operator  forms  an  internal  model  of  the  processes  he  is 
monitoring  and  of  the  environment  relevant  to  his  task  as  a result  of  his 
past  perceptions  of  them.  A situation  is  considered  in  which  the  operator 
seeks  to  detect  excursions  of  instruments  beyond  threshold  values.  The 
operator  is  modeled  as  directing  his  attention  to  the  instrument  whose 
current  probability  of  exceeding  threshold  (based  on  the  operator's  Internal 
model)  is  greatest.  It  might  be  noted,  in  passing,  that  the  internal  model 
concept  discussed  by  Smallwood  is  perhaps  as  apprcpriate  to  the  design  of 
automated  decision  makers  as  it  is  to  modeling  the  human  decision  maker.  If 
the  automated  decision  maker  is  to  interact  appropriately  with  the  human,  it 
would  seem  that  its  internal  model  of  the  relevant  environment  should  include 
a model  of  the  human. 

Carbonell  [3,4]  and  Senders  and  Posner  [5]  have  proposed  queueing  theory 
approaches  to  the  modeling  of  human  decision  making  in  multiple  process 
monitoring  tasks.  Carbonell  uses  a priority  queueing  discipline.  He  assumes 
that  the  human  operator  attempts  to  minimize  the  risk  involved  in  not 
observing  other  instruments  when  he  chooses  to  monitor  a particular 
Instrument.  Senders  and  Posner  employ  a first  come  first  served  service 
discipline.  They  suggest  two  models  which  might  be  used  to  estimate  the 
inter-observaticxi  intervals  for  an  instrument  (i.e.,  the  time  between 
arrivals  of  the  instrument  to  the  queue  of  instruments  awaiting  observation 
by  the  human  monitor).  The  first  model  involves  the  degree  of  the  observer's 
uncertainty  about  the  value  of  the  variable  displayed  on  the  instrument.  The 
second  model  Involves  the  probability  that  the  displayed  variable  will  exceed 
an  acceptable  limit. 

The  models  cited  above  emphasize  the  monitoring  of  displays,  rather  than 
the  decisions  or  actions  that  result  from  the  human  operator's  perception  of 
the  displayed  values.  The  cperator's  motivation  for  monitoring  the  displays 
is  the  possibility  that  an  event  which  requires  his  action  will  occur.  The 
multi-task  decision  making  problem  addressed  in  this  paper  concerns  the  event 
detection  and  action  selection  decisions  the  operator  makes  on  the  basis  of 
the  information  he  gains  throu(^  monitoring. 

Human  decision  making  in  such  multi-task  situations,  then,  might  be 
modeled  in  terms  of  the  manner  in  which  the  human  detects  events  related  to 
his  tasks  and  the  manner  in  which  he  allocates  his  attention  among  his  tasks 
once  he  feels  events  have  occurred.  Gai  and  Curry  [6]  have  developed  a model 
of  the  human  monitor  in  a failure  detection  task.  The  model  has  two  stages, 
the  first  being  a Kalman  filter  which  estimates  the  states  and  observations 
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of  .tile  monitored  process  and  the  second  a decision  mechanism  which  operates 
on  the  Kalman  filter  residuals  using  sequential  analysis  concepts.  The  model 
can  be  used  to  describe  the  human  monitor's  detection  of  additive  failures  in 
stationary  random  processes. 

Sheridan  and  Tulga  [?]  have  modeled  the  manner  "in  which  the  human 
operator  allocates  his  attention  among  various  tasks.  They  address  a 
situation  in  which  events  present  themselves  unequivocally  and  use  a dynamic 
programming  approach  to  determine  the  action  sequence  which  maximizes  the 
operator's  earnings.  This  action  sequence  is  begun,  but  can  be  superceded  by 
a new  sequence  calculated  in  response  to  the  appearance  of  additional  tasks. 

Rouse  [B]  has  investigated  the  issue  of  allocation  of  decision  making 
responsibility  between  a human  operator  and  an  automated  decision  maker.  He 
presents  a mathematical  formulation  of  the  multi-task  decision  making 
situation  appropriate  to  the  modeling  of  either  decision  maker.  Based  on 
displayed  information,  the  decision  maker  is  assumed  to  generate 
probabilities  that  events  have  occurred  in  his  tasks.  He  also  generates 
density  functicxis  which  characterize  his  perceptions  of  what  might  occur  in 
his  tasks  while  his  attention  is  diverted  to  a particular  task  and  how  long 
his  attenticxi  will  be  diverted  should  he  decide  to  take  a given  action. 
Combining  estimates  of  the  probabilities  events  have  occurred  with  the 
density  functions  of  time  between  events  in  the  tasks  and  action  times  with 
respect  to  the  tasks,  the  decision  maker  chooses  his  actions  to  minimize  an 
appropriate  cost  criterion.  In  this  paper,  we  present  a model  of  the  human's 
event  detection  performance  consistent  with  this  mathematical  formulation, 
describe  an  experimental  study  of  event  detection  performance  in  a multiple 
process  monitoring  situation,  and  address  the  application  of  the  model  to  the 
process  monitoring  situation. 


THE  EVENT  DETECTION  MODEL 


The  event  detection  model  assumes  that,  in  attempting  to  detect  events, 
the  human  generates  the  probabilities  that  events  have  occurred.  A 
discriminant  analysis  approach  [9,10]  is  used  to  model  the  human's  generation 
of  these  probabilities.  Our  use  of  discriminant  analysis  to  model  the 
human's  generation  of  event  probabilities  is  motivated  by  the  fact  that  this 
approach  does  not  require  explicit  models  of  the  systems  the  human  is 
monitoring.  An  understanding  of  the  systems  is  certainly  helpful  in 
determining  the  features  to  extract  from  the  observations.  But  explicit 
models  of  the  systems'  structures  are  not  required. 

For  each  task  i,  various  features  Xj^^,  J=1,2,  ...,m£,  are  extracted  from 
the  human's  task  related  observations  These  features  are  properties  of 

the  observations  that  characterize  (or  are  believed  to  characterize)  the 
presence  or  absence  of  events  related  to  the  task.  Following  the  extraction 
of  a set  of  features,  the  value  of  a linear  discriminant  function 
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(1) 


is  calculated.  Based  on  previous  experience  with  the  task,  estimates  are 
made  of  the  discriminant  function  coefficients  js1,2,  ...,mj^,  with  which 
to  combine  the  feature  values  to  obtain  the  'discriminant  function  score 
that  best  differentiates  observations  of  events  from  the  rest  of  the  task 
related  observations.  Estimates  of  the  mean  and  variance  of  the  discriminant 
function  over  observations  of  events  and  over  the  rest  of  the  observations 
are  also  formed.  The  a ppsteri<x»i  probability  that  an  event  has  occurred  is 
generated  using  the  value  of  the  discriminant  function  score,  the  estimates 
of  the  means  and  variances  of  this  score  over  events  and  "non-events",  and  an 
estimate  of  the  a priori  probability  of  the  event. 


If  the  human  operator  is  forced  to  make  a yes/no  response  on  the 
presence  of  an  event,  we  might  assume  that  he  chooses  the  response  ^ich 
maximizes  his  expected  reward.  We  can  then  express  his  decision  in  a signal 
detect i<xi-  manner  and  state  that  he  should  respond  "yes,  an  event  related  to 
task  1 has  occurred"  if  the  following  Inequality  holds: 

^ %A, 

1 - P(e,Aj 

P(ej^/Yj^)  is  tile  a posteriori  probability  that  an  event  related  to  task  i has 
occurred.  The  value  of  this  probability  is  generated  by  the  event  detection 
model.  Vqh  is  the  value  of  correctly  responding  "no  event"  (a  correct 
rejection),  is  the  cost  of  Incorrectly  responding  "event"  (a  false 

alarm),  Vy  is  tiie  value  of  correctly  responding  "event"  (a  hit),  and  Cj^  is 
the  cost  of  incorrectly  responding  "no  event"  (a  miss). 


It  is  predicted,  then,  that  if  the  operator  is  forced  to  make  a yes/no 
decisicn  on  the  presence  of  a task  related  event,  he  calculates  the 
likelihood  ratio  of  the  event  (the  left  hand  side  of  Eq.  (2)).  He  compares 
the  magnitude  of  the  likelihood  ratio  with  a threshold  determined  by  the 
values  of  correct  responses  and  the  costs  of  Incorrect  responses  (the  right 
hand  side  of  Eq.  (2)).  He  responds  "event"  if  the  likelihood  ratio  exceeds 
the  threshold. 


THE  EVENT  DETECHIION  EXPERIMENT 


An  experiment  has  been  run  employing  a situation  in  which  subjects 
simultaneously  monitor  several  dynamic  processes  for  the  occurrence  of  events 
and  make  yes/no  decisions  on  the  presence  of  events  in  each  process.  Figure 
1 illustrates  the  display  observed  by  the  subjects  in  the  experiment.  The 
static  display  was  generated  on  a Tektronix  4010  by  a time-shared  DEOSystem 
10  and  depicts  the  measured  values  of  tiie  outputs  of  nine  processes  over  100 
sampling  intervals  (l.e.,  101  points).  The  processes  had  identical  second 
order  system  dynamics  with  a natural  flrequency  of  0.75  rad/seo  and  a damping 
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Figure  1 . The  Multiple  Process  Monitoring  Situation 


ratio  of  0.5*  Samples  were  taken  at  0.2  second  intervals.  The  inputs  to  the 
processes  were  zero-mean  Gaussian  white  noise  sequences  of  identical 
variance.  The  displayed  measurements  were  obtained  by  corrupting  the  process 
outputs  with  additive  zero-mean  Gaussian  white  noise  sequences  which  normally 
had  identical  variance.  The  measurement  noise  variance  was  normally  selected 
to  yield  measurements  with  signal-to-noise  ratios  of  25.0.  An  abnormal  event 
in  a process  was  defined  by  an  Increase  in  the  measurement  noise  variance 
such  that  the  signal-to-noise  ratio  following  an  event  occurrence  was 
decreased  to  95%  of  the  signal-to-noise  ratio  of  the  preceding  measurement. 
Thus,  abnormal  events  became  more  pronounced  with  each  measurement  following 
their  occurrence. 

After  scanning  the  nine  process  histories,  the  subject  was  given  an 
opportunity  to  key  in  the  numbers  of  processes  in  which  he  had  decided  an 
abnormal  event  had  occurred.  He  was  then  given  feedback  regarding  the  actual 
states  of  the  processes  he  had  keyed  in  ("1"  indicating  the  normal  state,  "0" 
indicating  the  abnormal  state).  An  Iteration  in  a trial  was  completed  by 
erasing  the  display,  scoring  the  subject’s  performance,  and  returning  all 
abnormal  processes  detected  by  the  subject  to  the  normal  state.  Another 
Iteration  was  then  begun  by  generating  a new  display  depicting  the  process 
histories  advanced  10  sampling  intervals  in  time  as  illustrated  by  Figure  2. 
(The  dashed  vertical  lines  indicated  to  the  subject  the  point  at  which  he 
last  responded  to  each  process.) 
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Figure  2.  An  Updated  Display 


The  subject  was  allowed  to  respond  to  as  many  events  as  he  thous^t  had 
ooourred.  He  was  awarded  points  for  his  hits,  receiving  high  scores  for 
responding  to  events  soon  after  their  occurrence  and  lower  scores  for  tardier 
responses.  A flmd  number  of  points  was  deducted  for  each  false  alarm.  The 
subject  was  allowed  to  study  the  displays  as  long  as  he  wished,  but  any  time 
taken  beyond  the  first  minute  on  each  Iteration  reduced  the  score  awarded  for 
hits  made  on  that  iteration. 

Eight  subjects  were  given  three  trials  spaced  over  several  days.  Eadti 
trial  was  20  iterations  long.  The  first  and  third  trials  given  half  the 
subjects  were  identical,  with  one  :vent  scheduled  to  occur  per  iteration. 
Their  second  trial  scheduled  the  same  events  as  the  first  and  third  trials, 
but  also  scheduled  an  additional  event  occurrence  each  iteration.  The  rest 
of  the  subjects  were  given  the  same  trials  in  different  order  so  that  two 
events  were  scheduled  to  occur  per  iteration  in  the  first  and  third  trials 
while  one  occurrence  per  Iteration  was  scheduled  in  the  second  trial.  (Not 
all  scheduled  events  actually  occurred.  If  an  event  was  scheduled  to  occur 
in  a process  in  which  a previous  event  had  not  yet  been  detected  by  the 
subject,  the  scheduled  event  was  deleted  from  the  trial.)  Events  were 
scheduled  to  occur  uniformly  over  the  nine  processes  and  over  the  10  new 
points  displayed  for  each  process  on  each  iteration  (the  last  10  points  on 
the  first  iteration,  in  v/hioh  all  101  points  were  new)  within  the  constraint 
that  no  two  events  could  occur  in  a process  within  30  sampling  intervals  of 
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each  other. 


Before  each  trial,  the  subject  was  told  the  average  number  of  new  events 
he  could  exi/:>ot  to  occur  per  Iteration.  He  was  not  given  any  inforirtatian 
regarding  the  dynamics  of  the  processes,  but  was  told  that  he  could  expect 
the  processes  to  exhibit  similar  characteristics  when  operating  normally.  He 
was  also  not  told  what  parameter  changes  defined  events,  but  was  told  that 
all  events  would  generally  exhibit  similar  characteristics,  and  all  would 
become  more  pronounced  as  time  passed.  The  subject  was  given  several 
iterations  of  training  before  each  trial  during  which  solid  vertical  l.lnes 
were  included  on  the  process  histories  to  mark  exactly  when  and  where  e/ents 
had  occurred. 

During  each  trial,  the  subject  was  asked  to  keep  a log  in  which  he 
described  his  strategies  for  event  detection  and  noted  characteristics  of  the 
process  measurements  he  used  in  his  attempts  to  detect  events.  After  each 
trial,  he  was  asked  to  order  these  characteristics  in  terms  of  their 
usefulness  in  event  detection. 


APPLICATION  OF  THE  MODEL  TO  THE  EXPERIMENTAL  SITUATION 


The  event  deteoticxi  model  suggests  that  the  human  operator  in  the 
experimental  situation  Just  described  extracts  various  features  from  his 
observations  of  the  process  measurements.  He  attempts  to  select  features 
which  characterize  the  presence  or  absence  of  task  related  events.  Throu^ 
his  experience  with  the  processes,  the  operator  has  formed  estimates  of  the 
discriminant  function  coefficients  with  which  to  combine  the  features  to 
obtain  a discriminant  function  score.  He  has  also  formed  estimates  of  the 
means  and  variances  of  this  score  over  observations  of  events  and  over  the 
rest  of  his  observations.  The  operator  generates  the  liV:elihood  ratio  that 
an  event  has  occurred  based  on  the  value  of  the  discriminant  function  score, 
his  estimates  of  the  means  and  variances  of  the  score,  and  his  estimate  of 
the  a priori  probability  of  an  event  occurrence.  He  compares  the  likelihood 
ratio  with  a threshold  that  is  based  solely  on  the  values  of  correct 
responses  and  the  costs  of  incorrect  responses  and  responds  "event"  if  the 
likelihood  ratio  exceeds  the  threshold. 

Four  features  of  the  process  measurements  were  selected  for  use  with  the 
event  detection  model.  Selection  of  these  features  was  guided  by  the 
comments  of  the  experimental  subjects  regarding  the  characteristics  of  the 
process  measurements  they  found  useful  in  event  detection.  The  first  feature 
involves  the  magnitude  changes  between  successive  measurements  in  a seouence 
of  the  most  recent  measurements.  The  seoond  feature  involves  the  presence  of 
reversals  in  direction  in  this  sequence  (changes  from  .ositive  slope  to 
negative,  or  vice  versa,  of  the  line  segments  connecting  the  measurements  of 
the  sequence).  The  third  feature  tests  for  the  simultaneous  ooourenoe  of 
large  magnitude  changes  and  reversals.  The  fourth  feature,  like  the  first, 
is  a measure  of  magnitude  changes,  but  it  is  much  more  local  in  that  it 
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involves  only  the  four  moat  recent  measurements  of  the  process  output. 

In  extracting  these  features  from  the  process  measurosents,  the 
of  the  features  over  recent  measurements  are  weighted  more  heavily  than  trtv 
values  over  earlier  measurements.  The  weight  decreases  exponentially  w.tb 
the  age  of  the  measurement  and  the  rate  of  this  decrease  is  a free  parametet . 
The  value  of  the  first  feature,  for  example,  a measure  of  the  magnf.tudo 
changes  between  successive  measurements  in  a sequence  of  the  n most  recent 
measurements  of  a process'  output,  is  given  by 


*1 


{ S /9(n-1-k)]}/  ^exp[- /3(n-1-k)] 

k:t  kst 


(3) 


there  z(k)  is  the  k th  measurement  in  the  sequence,  z(n)  is  the  most  recent 
tueosurement,  and  /3  is  the  free  parameter  governing  the  relative  weighting  of 
the  feature's  value  over  recent  and  earlier  measurements  in  the  sequence. 

In  the  generation  of  the  likelihood  ratio  of  an  event  in  a process  at  a 
given  iteration  of  an  experimental  trial,  the  sequence  of  process 
measurements  over  which  the  features  are  calculated  ends  with  the  last 
measurement  displayed  for  the  process  on  that  iteration.  The  cutoff  length 
used  in  extracting  the  features  from  the  process  is  a free  parameter.  Values 
of  the  features  over  process  measurements  taken  earlier  than  the  cutoff  are 
not  calculated  (or,  effectively,  are  assigned  zero  weight).  If  the  subject 
responded  "event"  to  the  process  at  some  point  following  the  cutoff,  then 
features  are  calculated  over  only  those  measurements  occurring  after  this 
response.  The  information  on  the  state  of  the  process  that  the  subject  gains 
when  he  responds  to  the  process  motivates  this  constraint.  If  the  process  is 
in  the  normal  state,  then  on  succeeding  iterations  the  subject  knows  that  if 
an  event  has  occurred,  it  must  have  occurred  following  his  last  response.  If 
the  process  is  in  the  abnormal  state,  then  the  process  is  reset  to  normal 
when  the  subject  keys  in  his  response.  On  succeeding  iterations  the  subject 
knows  that  if  another  event  has  occurred  in  the  process,  it  must  have 
occurred  following  his  last  response.  In  either  case,  the  subject  (and  the 
model)  should  calculate  features  only  over  measurements  occurring  after  the 
subject's  last  response. 

The  estimation  of  discriminant  function  coefficients  requires  a 
representation  of  normal  and  abnormal  process  measurements.  This 
representation  was  formed  using  the  process  histories  displayed  to  the 
subject  on  his  third  experimental  trial.  The  process  histories  are  separated 
into  two  groups  of  sequences  - normal  and  abnormal.  Sequences  of 

measurements  begiiwing  when  a process  was  returned  to  the  normal  state  and 
ending  when  an  event  occurred  are  defined  to  be  normal.  Sequences  of 

measurements  beginning  when  an  event  occurred  and  ending  when  the  process  was 
returned  to  the  normal  state  are  defined  to  be  abnormal.  The  valuea  of  the 
four  features  were  calculated  over  the  entire  length  of  each  of  the  sequences 
in  the  two  groups.  A discriminant  analysis  was  then  performed  on  the 
resulting  two  groups  of  feature  values  to  determine  the  disorinlmnt  funotioo 
coefficients  Vj,  Jd,2,...,m,  with  which  to  combine  the  features  to  best 
differentiate  Between  the  two  groupa.  The  mean  value  and  the  variance  of  the 
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re«ilting  discriminant  function  scores  for  the  sequences  in  each  of  the  two 
groups  was  also  calculated. 

The  final  requirements  for  application  of  the  event  detection  model  to 
the  experimental  situation  are  estimates  of  the  a priori  probabilities  of 
event  occurrences  and  the  selection  of  a threshold  against  whioh  likelihood 
ratios  of  events  can  be  compared.  For  experimental  trials  in  which  one  event 
was  scheduled  to  occur  per  update  of  the  display  over  the  nine  processes 
monitored  by  the  subject  the  a priori  probability  of  an  event  occurrence  in 
each  process  was  fixed  at  1/9.  For  trials  in  which  two  events  were  scheduled 
to  occur  per  display  update,  the  a priori  probability  was  fixed  at  2/9.  The 
threshold  against  whioh  the  likelihood  ratios  of  events  are  compared  is 
assumed  to  remain  constant  through  an  experimental  trial.  The  magnitude  of 
this  constant  is  a free  parameter. 


RESULTS 


figure  3 compares  the  event  deteotiwi  performance  of  t.  e model  with  the 
actual  performance  of  each  of  the  eight  subjects  in  the  third  trial  of  the 
experiuient.  In  this  trial,  20  events  were  scheduled  to  occur  in  the  trials 
given  subjects  A,B,C,  and  D,  while  40  events  were  scheduled  to  ooour  in  the 
trials  given  subjects  B,f,Q,  and  K.  In  applying  the  model  to  each  of  these 
trials,  the  number  of  measurements  over  whioh  features  were  extracted  (cutoff 


figure  3.  Comparison  of  Model  with  Subjects  on  Third  Trial 
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length)  and  the  relative  weighting  of  recent  and  older  pointa  (/3)  were 
adjusted  to  improve  the  fit  of  the  model’s  performance  to  each  subject's 
performance.  The  value  of  the  threshold  against  which  likelihood  ratios  of 
events  were  compared  was  also  adjusted  to  Improve  the  fit.  Figure  3 reveals 
a high  degree  of  correspondence  between  the  model's  performance  and  the 
performance  of  o»st  subjects. 

Figure  H compares  the  event  detection  performance  of  the  model  with  the 
actual  performance  of  the  eight  subjects  in  the  second  trial  of  tiie 
experiment.  In  this  trial,  40  events  were  scheduled  to  occur  in  the  trials 
given  subjects  A,B,C,  and  D,  while  20  events  were  scheduled  to  occur  in  the 
trials  given  mibjects  EtF,G,  and  H.  In  applying  the  model  to  eroh  of  these 
trials,  none  of  the  parameters  of  the  model  were  changed  from  the  settings 
used  to  obtain  the  results  presented  in  Figure  3.  Despite  the  fact  that  the 
numbers  of  events  scheduled  in  these  trials  differ  from  those  in  the  trials 
used  to  assign  the  values  of  Uie  parameters,  the  correspondence  between  the 
model's  performance  and  the  performance  of  most  subjects  is  reasonable. 


Figure  4.  Comparison  of  Model  with  Subjects  on  Second  Trial 

Table  1 compares  the  mean  detection  times  (in  terms  of  the  number  of 
sampling  intervals  which  elapsed  from  the  coourrenoe  of  an  event  to  the  time 
of  its  detection)  for  hits  common  to  both  subject  and  model  in  the  trials 
presented  in  Figures  3 and  4.  It  should  be  noted  that  the  fact  that  the  mean 
detection  times  of  the  model  are  consistently  smaller  than  those  of  the 
subjects  is  an  artifact  of  the  manner  in  which  the  model's  performance  was 
investigated.  The  model  was  tested  on  the  process  histories  displayed  to  a 
subject  in  his  experimental  trial.  In  these  trials,  a process  was  returned 
to  the  normal  state  at  the  point  at  which  the  subject  detected  an  event  in 
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the  process.  Thus,  in  going  over  the  process  histories  the  model  can 
respond  to  an  event  later  than  the  subject  responded'  to  it.  If  the 
fails  to  respond  to  an  event  by  the  time  of  the  subject's  response,  the 
is  scored  as  liavipg  missed  that  event. 


never 

model 

model 


Table  1 . - Coniparisai  of  Mean  Detection  Times 


Trial 

Trial 

2 

Subject 

Subject 

Model 

Subject 

Model 

Code 

A 

24 

19 

24 

20 

E 

26 

21 

25 

19 

C 

28 

17 

28 

17 

D 

32 

21 

30 

16 

E 

18 

13 

22 

. 17 

P 

17 

14 

27 

16 

G 

20 

17 

27 

20 

H 

20 

17 

22 

18 

he  plan  to  evaluate  the  model  in  the  near  future  using  a somewhat 
different  approach.  Rather  than  running  the  model  over  the  process  histories 
displayed  to  a subject  on  an  earlier  experimental  trial  (and  constraining  the 
timing  of  the  model's  responses  by  the  timing  of  the  subject's  responses  in 
that  trial),  we  will  use  the  model  in  place  of  the  subject  in  the  event 
detection  experiment.  Processes  in  which  events  occur  will  then  remain  in 
the  abnormal  state  until  the  model  responds  to  the  process  The  only 
constraint  on  the  model’s  detection  times  will  be  the  end  of  the  experimental 
trial.  Because  the  model's  detection  time  for  each  event  need  no  longer  be 
less  than  or  equal  to  the  subject's  detection  time  for  that  event,  we  expect 
that,  for  a given  number  of  hits,  the  model's  threshold  can  be  raised  to 
achieve  the  longer  mean  detection  times  and  smaller  numbers  of  false  alarms 
characteristic  of  the  subjects  in  the  experiment. 


CONCLUDING  REMARKS 


In  applying  the  event  detection  model  to  the  experimental  situation 
described  in  this  paper,  we  studied  a situation  in  which  the  subject  was 
forced  to  respond  yes  or  no  to  the  possibility  of  an  event  related  to  each  of 
nine  processes.  In  general,  the  human  operator  is  not  forced  to  make  such 
yes/no  decisions  with  respect  to  each  of  his  tasks.  Instead  he  uses  his 
estimates  of  the  probabilities  of  task-related  events  (which  the  event 
detection  model  generates)  in  deciding  how  to  allocate  his  attention  among 
his  tasks.  We  plan  to  run  an  experiment  investigating  the  human's  attention 
allocation  performance  in  a multiple  process  monitoring  situation  similar  to 
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the  one  employed  in  the  event  detection  experiment  discussed  here.  Data  from 
this  experiment  will  be  used  to  develop  and  validate  a model  of  attention 
allocaticxi  performance  in  multi-task  situations.  (The  modeling  of  human 
attenticxi  allocation  performance  in  multi-task  situaticxis  is  considered  in 
[11].)  This  model  might  be  used  in  conjuncticxi  with  the  event  detection  model 
as  a part  of  the  design  process  for^  and  the  implementation  of,  automated 
decision  making  systems. 
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SUMMARY 

An  experimental  representation  of  a computer-aided  multi-task  flight 
management  situation  has  been  developed . A computer  aiding  program  was 
implemented  to  serve  as  a back-up  decision  maker.  An  experiment  was 
conducted  j with  a balanced  design  of  several  subject  runs  for  different 
workload  levels.  This  was  achieved  using  three  levels  of  subsystem  event 
arrival  rates,  three  levels  of  control  task  involvement,  and  three  levels  of 
availability  of  computer  aiding.  Experimental  results  compared  quite 
favorably  with  those  from  a computer  simulation  which  employed  a 
(M/Ej^/2):(PRP/K/K)  queueing  model.  It  was  shown  that  the  aiding  had  enhanced 
system  performance  as  well  as  subjective  ratings,  and  that  the  adaptive 
aiding  policy  further  reduced  subsystem  delay. 

INTRODUCTION 

As  aircraft  become  more  complicated  and  greater  demands  and  better 
performance  are  being  required  of  pilot,  the  development  of  automated 
airborne  systems  to  share  the  tasks  of  piloting  an  airplane  becomes 
increasing  attractive.  Advances  in  electronics  and  computer  technology  have 
made  this  approach  both  feasible  and  promising.  Progress  in  sophisticated 
cockpit  design  and  growth  in  avionic  computer  systems  reflect  the  trend. 

Equiped  with  autopilot  and  airborne  computers  performing  automatic 
navigation,  guidance,  energy  calculations,  flight  planning , information 
management,  etc.,  the  next-generation  of  aircraft  are  quite  likely  to  be 
capable  of  carrying  out  all  phase  of  flight  automatically.  However,  the 
human  pilot  is  likely  to  reamln  a part  of  the  system  to  cope  with  unpredicted 
or  failure  situations  for  which  automation  may  be  economically  or  politically 
Infeasible.  The  pilot's  roll  then  is  changing  from  one  of  controller  to  one 
of  supervisor  and  manager,  respcmsible  for  monitoring,  planning  and  decision 
making. 

* This  research  was  supported  by  the  National  Aeronautics  and  Space 
Administration  under  NASA-Ames  Grant  NSG-2119. 
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The  pilot  as  the  airborne  system  manager  has  responsibility  to  monitor 
the  aircraft  subsystems  such  as  navigation,  guidance,  etc.  as  well  as  the 
autopilot  and  to  detect  possible  hardware  failures  and  potential  hazards.  He 
must  constantly  respond  to  action~evoking  events  such  as:  to  communicate 
information,  to  change  aircraft  configuration  and  to  reduce  4-D  accuracy 
errors.  He  is  also  required  to  respond  to  unexpected  events  such  as  a change 
in  flight  plan,  to  establish  the  backup  mode,  and  to  declare  emergencies, 
etc.  [1].  The  pilot  is  in  a multi-task  situation. 

If  the  pilot  perceives  an  irregularity  in  one  of  the  subsystems,  he  may 
seek  more  detailed  information  through  either  the  on-board  information  system 
or  actual  sensor  readings.  Or,  if  he  considers  the  irregularity  to  be  minor, 
he  may  decide  to  continue  his  monitoring  for  higher  priority  events.  There 
may  also  be  autopilot  malfunctions  or  sudden  changes  requiring  the  pilot  to 
take  charge  of  flight  control . A proper  representation  of  information 
through  a flight  map  display  indicating  the  continuous  functioning  of 
automatic  control  may  help  to  ensure  his  remaining  alert  and  responding 
quickly. 

As  described  above,  the  automated  system  can  normally  take  charge  of  the 
whole  system  except  during  critical  situations  such  as  when  the  system  is 
suffering  from  a malfunction.  Or  a high-workload  situation  may  develop  when 
the  aircraft  is  close  to  the  ground  when  a high  level  of  pilot  activity  is 
requit^ed.  In  all  of  these  situations,  the  pilot  is  more  than  usually  busy 
and  further  assistance  of  a computer  would  be  most  useful. 

The  recent  development  of  fast  and  intelligent  computer  systems  presents 
the  potential  for  providing  sound,  well-evaluated  airborne  decisions  which 
could  reduce  system  risk,  pilot  workload  and  errors.  While  the  computer  as  a 
decision  maker  is  basically  an  Implemented  set  of  algorithms,  adaptation  and 
learning  is  possible.  It  is  reasonable  to  expect  that  this  evolving 
"intelligent"  computer  may  be  employed  as  the  supervisor  to  the  subsystem 
computers,  taking  charge  of  the  tasks  within  its  decision  capability.  The 
pilot  and  the  computer  thus  have  comparable  abilities  and  overlapping 
responsibilities  in  performing  these  tasks.  The  problem  that  arises  is  how 
to  allocate  responsibility  between  the  pilot  and  the  computer  for  a subset  of 
all  tasks. 

We  have  proposed  that  responsibilities  not  be  strictly  assigned  to  each 
decision  maker.  Instead,  allocation  should  adapt  to  the  state  of  the 
aircraft  and  the  state  of  the  pilot  [2].  Further,  to  retain  a coherent  role, 
the  pilot  should  be  given  overall  responsibility  for  the  whole  aircraft  while 
the  computer  would  enable  the  pilot  to  avoid  having  to  continually  exercise 
all  of  these  responsibilities.  On  one  hand,  it  may  not  be  appropriate  for 
the  computer  to  make  the  vital,  final  judgement  where  losses  may  extend 
beyond  the  point  of  recovery.  On  the  other  hand,  there  may  be-  vigilance 
problems  and  the  pilot's  performance  may  degrade.  This  leads  to  the  idea  of 
utilizing  the  computer  as  a backup  for  the  pilot.  The  allocation  problem 
becomes  one  of  deciding  when  the  computer  should  request  and  relinquish 
responsibility. 
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Given  these  descriptions,  we  will  explore  several  issues  concerned  with 
pilot  decision  making  in  computer-aided  flight  management  situations.  Is 
system  performance  enhanced  by .computer  aiding?  How  effective  are  different 
aiding  policies?  How  does  the  pilot  feel  about  aiding?  Is  his  role  or 
performance  affected?  To  investigate  the  feasibility  of  the  approach,  and  to 
predict  the  effects  of  numerous  system  variables  and  aiding  policies,  a 
queueing  formulation  of  multi-task  decision  making  was  developed  and  will  be 
discussed  in  the  next  section. 

APPROACH 

^ The  pilot  in  the  automated  flight  management  system  described  earlier 
has  a variety  of  tasks  to  perform.  As  the  number  and  variety  of  tasks 
"increases,  the  workload  of  the  pilot  is  increased.  It  is  essential  to 
appropriately  allocate  his  attention  and  effort  among  the  tasks.  He  may  be 
in  a situation  that  he  wants  both  to  monitor  the  tasks  often  enough  to  reduce 
growing  uncertainty  and  risk,  a- 1 to  perform  a task  quickly  and  accurately  to 
lessen  the  cost  involved  in  the  delay  of  action.  This  issue  is  being 
investigated  by  Greefistein  and  Rouse  [3].  To  simplify  the  issue,  the  pilot 
is  assumed  to  employ  a quasi -optimal  decision  making  strategy  for  scanning 
displays  and  allocating  attention.  This  is  based  on  the  assumptions  that  the 
tasks  are  independent  and  that  events  unequivocally  present  themselves.  The 
pilot  scans  the  task  display  in  order  of  decreasing  priority  at  a given  rate. 
He  then  performs  the  first  task  for  which  he  perceives  some  action-evoking 
events.  The  computer  is  assumed  to  adapt  the  same  strategy  either  by  being 
hard-wired  or  learning  from  the  pilot.  Now  we  may  look  at  the  multi-task 
decision  making  as  a queueing  system  with  two  servers  (the  pilot  and  the 
computer)  and  K+1  classes  of  customers  (K  subsystem  events  plus  control 
events  represented  by  displayed  4-D  errors  in  manual  control  mode) . 

In  the  queueing  model,  each  server  is  characterized  by  his  observation 
of  system  state,  his  perceptions  of  event  occurrences,  of  event  arrival  rates 
and  of  event  service  rates.  Combining  the  above  information  and  the  system 
cost  crlteion  allows  the  model  to  predict  system  performance  measures  such  as 
event  delay  statistics  and  server  occupancy  which  is  fraction  of  time  the 
server  is  busy. 

A convenient  cost  criterion,  in  terms  of  a stationary  expected  cost 
structure,  includes  waiting  cost,  service  cost,  and  switching  cost.  When  the 
computer  service  cost  and  switching  cost  may  be  negligible,  the  optimal 
policy  is  to  have  the  computer  on  all  the  time.  However,  it  is  more  likely 
that  the  human  will  be  better  at  performing  the  task  but  not  have  sufficient 
time  to  do  all  the  tasks.  Also  evidence  of  vigilance  and  warm-up  decrements 
suggests  that  there  is  an  acceptable  workload  range  that  sustains  performance 
on  long  tasks.  Thus  we  may  want  to  seek  a policy  for  computer  aiding  such 
that  a minimum  waiting  cost  is  achieved  while  maintaining  a specified 
workload  level. 

Based  on  results  from  literature  [*•],  wo  will  advocate  the  use  of  the 
stationary  expected  cost  policy,  subject  to  minimizing  deviation  from 
acceptable  pilot  workload,  for  computer  on-off  of  the  following  form:  turn 
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the  computer  on  at  arrival  epochs  when  N = c.n.  + c-n^  + ...  + > M,  and 
turn  it  off  when  N < m,  where  c.,  Cp*  ...»  Oj^^are  cost  rates  assessed 
according  to  relative  priorities  and  nf  is  the  number  of  events  waiting  in 
the  subsystem  k.  This  policy  (i.e.,  M and  m)  should  vary  as  the  system 
variables  vary.  Specific  values  of  M and  m have  to  be  determined  for  various 
levels  of  traffic  demand  (i.e.,  event  arrival  rates),  server  performance  and 
task  complexity  (i.e.,  service  rates  and  probabilities  of  errors).  An 
appropriate  approach  to  implement  the  adaptive  policy  is  to  set  up  a table  of 
stationary  control  policies  beforehand  and  to  employ  a table  look-up  along 
with  on-borad  estimation  of  system  variables. 

To  obtain  the  optimal  stationary  policy,  i.e.,  to  determine  the  values 
of  M and  m,  a computer  simulation  was  performed.  Poison  arrivals  and  Erlang 
service  time  distributions  for  subsystem  were  assumed.  The  K subsystem  tasks 
were  preempted  by  the  control  task  whenever  it  occurred.  The  system  was 
represented  as  a preemptive  resume  priority  queueing  system: 
(M/Ej^/2):(PBP/K/K)  with  implemented  threshold  control. 

. A simple  case  was  considered  in  which  the  model  parameters  were 
determined  in  the  following  manner.  1)  Subsystem  arrival  rates,  service 
rates,  and  waiting  cost  rates  were  all  uniform  among  the  subsystems.  2)  Two 
levels  of  arrival  rates  were  assumed,  i.e.,  low  arrival  (at  0.0167  events  per 
second)  and  high  arrival  (at  0.0333  events  per  second).  3)  Pilot  performance 
in  terms  of  service  rates,  service  errors  and  control  services  were  obtained 
from  the  experiment  discussed  in  the  next  section.  4)  The  computer  aiding 
employed  the  same  service  rates  as  the  pilot  and  automatically  went  off  when 
no  event  needed  service  (i.e.,  m=0).  The  results  based  on  the  computer 
simulation  of  10,000  events  for  K=6  and  server  occupancy  for  pilot  of  =0.7 
showed  that,  without  control  task,  M=7  for  low  arrival  and  3 for  high 
arrival;  with  control  task,  M=3  for  low  and  1 for  high  arrival.  If  workload 
is  the  primary  consideration,  these  are  threshold  values  which  the  computer 
should  employ  to  adapt  to  both  the  subsystem  arrival  rate  and  the  control 
task  involvement. 

Prediction  of  system  performance  by  the  model  was  also  obtained  through 
the  computer  simulation.  The  results  will  be  discussed  in  the  later  section. 

THE  EXPERIMENT 

Two  experiments  are  to  be  discussed  here.  A brief  review  is  given  of  an 
experiment  previously  reported  by  Walden  and  Rouse  [5]  investigating  pilot 
decision  making  in  an  unaided  situation.  The  second  experiment,  considering 
the  computer  aiding  and  autopilot  malfunction  situations,  employs  basically 
an  outgrowth  of  the  experimental  representation  used  in  the  previous 
experiment . 

The  experimental  situation  developed  earlier  [6]  used  a PDP-11  driven 
CRT  graphic  system  to  represent  a cockpit-like  display  to  an  experimental 
subject.  The  display  shown  in  Figure  1 included  standard  aircraft 
instruments  such  as  artificial  horizon,  altimeter,  heading  and  airspeed 
indicators.  Also  displayed  was  a flight  map  which  indicated  the  airplane's 
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position  relative  to  the  course  to  be  followed.  A small  circle  inoved  along 
the  mapped  course  indicating  the  position  the  aircraft  should  have  for  it  to 
be  on  shoedule. 


Figure  1.  Tne  Flight  Management  Situation. 

In  the  manual  control  mode,  the  pilot  controlled  the  pitch  and  roll  of 
Boeing  707  aircraft  dynamics  with  a joystick.  Another  control  stick 
controlled  the  airspeed.  The  pilot's  control  task  was  to  fly  the  airplane 
along  the  mapped  route  while  maintaining  a fixed  altitude  and  stable  pitch 
and  roll  attj,tude. 

Below  the  map  were  the  subsystem  dials  that  represented  the  numerous 
aircraft  subsystems  which  the  pilot  monitored  for  possible  action-evoking 
events.  Upon  detecting  an  event  (represented  by  the  pointer  pointing 
downward  as  shown  for  the  engine  subsystem  in  Figure  1)  to  which  he  wished  to 
respond,  the  subject  selected  that  subsystem  via  a 4x3  kevboard.  The  display 
shown  in  Figure  2 then  appeared.  This  represented  the  first  level  of  a check 
I'ist-like  tree  associated  with  the  subsystem  of  interest.  He  then  searched 
for  a branch  labeled  with  a zero  and  seleted  the  branch  with  his  keyboard. 
After  completing  the  last  level  of  the  tree,  the  action  was  completed  and  the 
display  shown  in  Figure  1 returned,  with  the  subsystem  information  or 
diagnostic  check  complete. 

Using  the  experimental  situation,  an  experiment  was  performed  by  Walden 
[5]  to  study  unaided  pilot  decision  making  strategies  and  the  resulting 
performance.  The  two  independent  variables  in  the  experiment  were  the 
inter-arrival  time  of  subsystem  events  and  the  difficulty  of  the  flight  path. 
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The  results  showed  that,  while  average  waiting  time  increased  with  subsystem 
event  arrival  rate,  the  average  service  time  appeared  to  be  independent  of 
subsystem  arrival  rate.  The  waiting  time  was  also  shown  to  increase  as  the 
control  task  was  added.  This  effect  was  only  a function  of  the  mere  presence 
of  the  control  task,  rather  than  the  control  task  difficulty.  Incorrect 
actions  in  servicing  subsystems  tended  to  increase  with  subsystem  arrival 
rate,  but  showed  no  consistent  variation  with  control  task  difficulty.  False 
alarms,  however,  tended  to  occur  more  frequently  with  the  easier  control  task 
and  lower  subsystem  arrival  rate.  This  presented  evidence  of  performance 
degradation  under  low  workload  situations. 


BRANCH  eng  1 ENG  2 ENG  3 ENG  4 

state  10  11 


Figure  2.  Display  Hhen  Pilot  Had  Reacted  To  an  Event  in  Engine  Subsystem. 

The  data  collected  was  used  in  the  queueing  model  of  pilot  decision 
making  in  an  unaided  monitoring  and  control  situation.  The  model  gave  a 
reasonable  prediction  of  pilot  performance  in  performing  subsystem  tasks, 
suggesting  that  it  was  an  adequate  description  of  pilot  decision  making  in 
the  given  situation  and  that  a similar  model  would  be  useful  in  the  adaptive 
aiding  system. 

Based  on  the  experimental  representation  discussed  above,  a new 
experimental  situation  for  adaptive  aiding  was  developed  with  the  aiding 
program  (i.e.,  the  computer  decision  maker)  and  the  coordinator  program 
(i.e.,  the  on-off  algorithm)  added  to  the  original  system.  Issues  concerning 
the  capability  of  the  computer  to  perform  the  subsystem  tasks,  the 
communication  linl^^e  between  the  pilot  and  the  computer,  and  the  activities 
of  the  coordinator  deserve  further  discussion. 
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The  computer  is  assumed  to  be  able  to  perforin  monitoring  and  diagnostic 
check  procedures  using  Information  from  channels  linked  with  subsystem 
computers  and  from  the  data  links.  It  makes  no  errors  such  as  false  alarms, 
missed  events,  or  incorrect  actions  after  it  gains  confidence  in  performing 
the  task.  The  detection  and  service  times  are  assumed  constant.  As  for  the 
service  discipline  among  the  subsystems,  the  computer  employs  the  same 
priority  rule  as  that  used  by  the  pilot.  To  be  consistent  in  its  back-up 
role,  the  computer  probably  adapts  itself  to  the  pilot  and  avoids 
interference  with  him.  To  this  end,  the  pilot  is  allowed  to  override  any 
decision  the  computer  has  made. 

Without  knowing  what  each  other  is  doing,  the  pilot  and  the  computer  may 
compete  for  the  same  task  or  resource.  The  prospect  of  conflict  between  the 
two  is  highly  undesirable,  since,  it  simply  causes  confusion,  results  in 
higher  workload  and  degraded  performance,  ^^e  question  as  to  how  to  design 
effective  communication  links  without  increasing  the  pilot's  workload  becomes 
important . 

To  Inform  the  pilot  of  the  computer's  action,  a succinctly  displayed 
computer  status  indicator  on  or  near  the  subsystem  displays  would  seem  to  be 
satisfactory.  Relevant  Information,  if  needed  by  the  pilot  for  further 
details,  may  be  structured  into  a hierarchical  check-list  procedure.  In  the 
experimental  situation  shown  in  Figure  3,  ‘I'he  'NAV  symbol  over  the 
navigation  dial  flashed,  if  the  computer  decided  that  an  event  had  occurred 
and  was  waiting  to  be  serviced  in  the  navigation  system.  This  was  to  tell 
the  pilot  that  he  could  take  charge  of  the  navigation  system  and  the  computer 
would  take  some  other  responsibility  to  avoid  interference;  otherwise,  the 
symbol  would  continue  to  flash  for  a total  period  of  four  seconds  until  the 
computer  started  interacting  with  the  navigation  system,  resulting  in  a dim 
indicator  showing  in  the  navigation  dial.  If  the  pilot  was  in  the  middle  of 
performing  some  other  subsystem  check  procedure,  say,  within  the  engine 
system,  he  would  not  see  the  flashing  'NAV  symbol  over  the  navigation  dial. 
The  status  of  the  computer  was  then  shown  on  the  lower  right  hand  corner  of 
the  CRT  by  an  'AIDING  NAV  symbol  (flashing  during  the  interval  of  possible 
pilot  preemption),  if  the  computer  was  awaiting  preemption  or  Interacting 
with  the  navigation  subsystem.  This  computer  status  area  was  blank  if  the 
computer  was  not  actively  Involved  in  the  subsystems. 

Airborne  pilot- to-oomputer  ooauaunication  is,  in  general,  more 
complicated.  Problems  involved  include  estimating  and  processing  signals  as 
well  as  matching  or  recognising  system  status.  For  the  purpose  of  the 
experiment  reported  here,  however,  the  communication  channel  from  the  pilot 
to  sybaystems  was  predefined.  For  our  experimental  situation,  these  included 
the  keyboard  input  and  stick  response  sampling  (through  an  A/0  converter). 
These  channels  provided  the  monitoring  computer  a way  of  determining  if  the 
pilot  was  interacting  with  any  portion  of  the  system.  If  a number  had  been 
received  through  keyboard,  and  the  checklist  was  being  processed  then  the 
pilot  had  to  be  performing  a subsystem  task.  The  deviation  of  stick  from 
normal  position  revealed  that  the  pilot  was  performing  the  control  task. 
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Figure  3.  Display  When  the  Cooputer  Is  Servicing  Navigation  System. 

While  the  computer  had  to  constantly  check  the  pilot* a action  to  avoid  a 
conflict,  the  coordinator  had  to  synchronously  check  the  subsystem  states  to 
determine  if  there  was  any  system  change.  The  decision  epoch  was  when  an 
event  arrival  or  departure  occurred.  Then  the  coordinator  calculated  both 
the  weighted  sum  of  events  and  the  threshold.  The  criterion  discussed 
earlier  was  used  to  determine  if  the  computer  was  to  be  turned  on  at  the 
arrival  epoch  or  to  be  turned  off  at  completion  epoch. 

Data,  sampled  synchronously  (twice  per  second),  included  subsystem 
status  and  states,  autopilot  status,  aircraft  dynamic  variables,  stick  and 
keyboard  responses,  computer  status  and  the  threshold  values. 

An  experiment  based  on  the  experimental  representation  described  above 
was  conducted.  Eight  trained  subjects,  all  of  them  male  students  in 
engineering,  participated  in  a balanced  se<)uenoe  of  sixteen  experimental  runs 
(see  Table  1)  with  different  workload  levels,  niis  was  achieved  by  oMbining 
three  levels  of  control  task  involv«ient  (perfect  autopilot,  manual  control, 
autopilot  with  possible  malfunctions) , three  levels  of  subsystem  event 
arrival  rates  (no  arrival,  low  arrival,  high  arrival),  and  three  levels  of 
availability  of  computer  aiding  (no  aiding,  aiding  with  fixed  switching 
policy,  and  aiding  with  adaptive  policy).  For  each  experimental  run,  the 
subject  was  first  told  the  specific  tasks  to  perform,  then  a lA>mlnute  trial 
was  given,  and  a questionare  was  filled  out  by  the  subject. 
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Table  Design  of  Bxperifflent. 


jMt  1 

8ubJ«dv  i 

Aifbjget  ) 

Suhjret  « 

(training) 

(irnining) 

(training) 

tw  iff  iwst 

lew  arrival 

high  arrival 

high  arrival 

With  sNiM 

without  aiding 

with  aiding 

without  siding 

AiAagltH 

iav  arrival 

lew  arrival 

htrh  arrival 

high  arrival 

wilhgut 

NalfunetlM 

witfieut  aiding 

with  aiding 

withnut  aiding 

with  aiding 

Man  arrival 

hirh  arrival 

lew  arrival 

lew  arrival 

witA  atdini 

without  aiding 

with  aiding 

witheut  aiding 

High  arrival 

high  arrival 

lew  errival 

l«w  arrival 

atiiKHit  aiding 

with  aiding 

witheut  aiding 

with  siding 

UpalAlnt) 

(training) 

(training) 

(trainifw) 

ga  arrival 

no  arrival 

no  arrival 

no  arrival 

law  arrival 

lew  arrival 

high  arrival 

Mrh  arrival 

witA  aldiflf 

Witfieut  aiding 

with  atdtrg 

witheut  aiding 

IfMMi 

Centret 

lew  arrival 

tew  arrival 

high  arrival 

hirh  arrival 

witmnA  aiding 

with  aiding 

wiinnut  aiding 

with  aiding 

Alglt  arrival 

high  arrival 

Igw  arrival 

lew  arrival 

wtVi  aiding 

without  aiding 

with  aiding 

without  aiding 

gigti  arrival 

htvh  arrival 

l*w  arrival 

tew  arrival 

wiliNMH  aiding 

vllH  aidtar 

vilheut  atoing 

with  siding 

(tralAt/*g) 

(training) 

(tralnipg) 

Uraintng) 

m arrival 

na  arrival 

no  arrival 

ne  arrival 

taw  arrival 

lew  arrival 

•ugh  arrival 

hl»H  niTlval 

will’  sidin« 

wiUiouk  aiding 

wild  aiding 

witheMt 

lew  arrival 

taw  arrival 

hirh  arrival 

high  arrival 

wi«Mwt  aiding 

with  aidw.g 

viUnut  aiatna 

with  uainr 

WttA 

High  arrival 

hifK  arrival 

Inw  arrive! 

W arrival 

Kstrunsitan 

with  ai.^ma 

wiUwitt  aiding 

with  aiding 

wiuuut  aiding 

high  arrival 

hirh  arrive; 

law  arrival 

i-nt  arrival 

wtllieiA  tiding 

with  aiding 

witlw^  atdirg 

with  aiding 

Ivw  arrival 

l«w  arrival 

high  amvnl 

high  arrival 

•diglive  aid 

adaptive  aid 

adsaiive  aid 

adept  tv*  aid 

high  arrival 

hieh  arrival 

Inw  arrival 

leu  arrival 

adaptive  aid 

adaptive  aid 

adapt  i««  aid 

adepiive  aid 

For  the  experiaent  rune  with  perfect  autopilot,  only  the  aubayatem  task 
was  considered.  An  "autopilot"  kept  the  airoraft  on  course  and  on  schedule. 
These  runs  served  as  baseline  perforaance  for  the  subsystea  task.  In  the 
aanual  control  runs,  the  subject  had  to  perfora  both  subsystea  and  control 
task.  He  was  told  that  the  control  task  was  aore  iaportant  than  the 
subsystea  task.  For  the  runs  where  autopilot  aaufunotions  were  posible,  the 
autopilot  was  available  during  aost  of  the  experiaent  such  that  the  subject 
was  not  required  to  fly  the  airplane  except  to  occasionally  check  autopilot 
perforaance.  As  soon  as  he  detected  an  autopilot  aalfunction,  which  was 
characterised  by  the  airplane  deviating  froa  the  aapped  course  at  a rate  of 
one  degree  per  second,  he  was  required  to  take  over  the  flight  control  task, 
and  fly  the  airplane  back  to  the  aapped  course.  In  this  case,  the  airplane 
would  lock  on  the  desired  course  as  soon  as  it  flew  within  the  800-feet  oval 
of  the  on-schedule  circle,  and  the  autopilot  node  was  restored.  The 
autopilot  aalfunction  happened  relatively  infrequently,  based  on  a Poison 
distribution  with  aean  inter-arrival  tine  of  160  seconds. 
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After  the  pilot  detected  the  autopilot  fflalfunotion,  he  would  have  to 
devote  a major  portion  of  hla  attention  to  the  control  task,  leaving 
subsystem  tasks  less  attended,  while  risk  and  uncertainties  grew  as  subsystem 
event  detection  and  service  were  further  delayed.  This  Is  one  of  many 
situations  In  which  airborne  computer  aiding  Is  more  valuable.  Also,  in  this 
period,  the  pilot's  workload  suddenly  Increased.  To  adapt  to  this  type  of 
change,  a lower  threshold  value  can  be  used  to  reduce  subsystem  service  delay 
and  pilot  workload. 

Based  on  this  idea,  two  experiment  runs  with  adaptive  computer  aiding 
were  Included  in  the  set  of  runs  with  autopilot  malfunctions  possible. 
Instead  of  using  Ms3  all  the  time  as  in  the  fixed  threshold  policy,  the 
adaptive  policy  used  MbI  whenever  the  pilot  was  In  manual  mode.  In  total, 
there  were  seven  experimental  runs  with  autopilot  malfunction:  one  run  with 

no  subsystem  arrival  (serving  as  a baseline  performance  for  malfunction  ), 
two  runs  with  no  aiding,  two  with  fixed^threshold  aiding,  and  two  with 
adaptive  aiding.  This  arrangement  allowed  for  the  evaluation  for  the 
effectiveness  of  computer  aiding  and  further  the  benefit  of  thd  adaptive 
policy  beyond  that  of  fixed  aiding. 

Three  or  more,  depending  on  the  task  situation,  of  the  following 
performance  measures  were  evaluated  in  every  experimental  run: 

1)  average  delay  in  response  and  service  for  subsystem  events, 

2)  subsystem  service  errors  (e.g.,  fal;.e  alarms,  incorrect  actions,  etc.), 

3)  3-D  RMS  and  average  flight  course  errors, 

4)  flight  control  Inputs  including  aileron,  elevator,  speed,  etc., 

5)  detection  and  service  times  for  autopilot  malfunctions, 

6)  server  occupancy  In  terms  of  the  fraction  of  time  the  subject  was 
performing  either  subsystem  or  control  tasks, 

7)  subjective  ratings  of  level  of  effort  required  for  the  tasks  and  the 
desirability  of  computer  aiding. 

All  these  measures  were  obtained  by  analyzing  the  sampled  data.  The 
subsystem  event  response  time  was  measured  from  the  time  of  event  occurrence 
to  the  time  at  which  an  action  was  initiated.  The  service  time  was  measured 
from  the  time  of  last  action  initiation  to  the  time  of  action  completion  for 
the  event.  The  waiting  time  was  measured  from  the  time  of  event  occurrence 
to  the  time  of  action  completion  for  the  event.  Waiting  time  is  equal  to  the 
sum  of  response  time  and  service  time  only  when  the  event  is  serviced  by  one 
server  and  no  incorrect  action  is  incurred.  The  results  based  on  the 
analyses  of  variance  are  discussed  in  the  next  section. 

RBSUtTS 

The  subsystem  event  waiting  times  averaged  across  subjects  for  the 
various  task  situations  are  shown  in  Figure  4.  An  analysis  of  variance 
conducted  showed  that  among  the  statlstloally  significant  factors  (at  the  .05 
level)  are  the  three  experiment  variables,  l.e.,  the  control  mode,  the 
subsystem  arrival  rates,  and  the  computer  aiding.  As  expected,  the  subsysti^^m 
waiting  time  increased  as  the  subsystem  arrival  rate  increased,  as  the 
control  involvement  increased,  and  when  no  censputer  aiding  was  provided.  A 
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separate  test  showed  that  the  adaptive  policy  was  also  significant,  i.e.,  the 
adaptive  aiding  further  reduced  the  subsystem  waiting  time  beyond  the 
fixed-threshold  aiding,  even  though  the  adaptive  policy  was  only  effective 
during  a small  portion  of  time  in  the  experiment. 

The  subjective  ratings  of  the  level  of  effort  across  subjects  are  shown 
in  Figure  5 Factors  of  significance  include  all  three  experiment  variables. 
As  expected,  the  perceived  level  of  effort  Increased  as  control  involvement 
increased,  as  subsystem  arrival  increased,  and  as  computer  aiding  was 
removed.  However,  a separate  test  showed  that  the  effect  of  the  adaptive 
policy  was  not  significant,  probably  because  the  adaptive  policy  was  employed 
rather  infrequently,  and  when  it  was  being  used,  the  subjects  usually  were 
too  involved  with  restoring  the  autopilot  to  notice  the  fact  that  the 
computer  wdo  helping  more  often  then  usual. 


Figure  4 Average  Subsystem  Delay.  Figure  5 Subjective  Ratings  of  Effort. 

The  RMS  course  error  across  subjects  is  shown  in  Figure  6.  The  analysis 
of  variance  showed  that  only  control  mode  had  an  effect  on  the  control  error. 
No  consistent  variation  in  the  course  error  was  shown  as  subsystem  arrival 
rate  or  aiding  situation  varied.  The  lower  course  RMS  error  for  the 
autopilot  malfunction  mode  probably  resulted  from  subject's  more  intense 
attention  to  the  control  task  in  the  case  of  malfunction. 

The  RMS  roll  angle  across  subjects  is  shown  in  Figure  7.  Also,  only 
control  mode  had  a significant  effect  on  the  control  input.  The  subjects 
were  found  to  use  more  extreme  control  actions  and  more  attention  to  fulfill 
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the  malfunction  task  requirements.  Sumarlzing  the  above,  systems  that  are 
designed  to  relax  control  requirements,  such  as  the  autopilot,  seem  to 
improve  both  control  and  subsystem  performance,  while  systems  that  are 
designed  to  relax  subsystem  requirement,  such  as  computer  aiding  or  highly 
reliable  subsystems,  seem  to  improve  only  subsystem  performance.  The 
possible  reason  for  this  is  that  the  control  task  perempts  subsystem  tasks, 
and  thus,  the  control  task  inefficiency  is  likely  to  affect  the  performance 
of  subsystem  tasks;  the  reverse  is  not  true. 


Subsyttm  itrrliril  ffaU  <Ve 


arrSvil  r»U 


Figure  6.  BMS  Course  Error. 


Figure  7>  RMS  Roll  Angle. 


Subjective  ratings  of  three  aspects  of  computer  aiding  were  also 
determined:  effectiveness,  desirability  of  the  aiding,  and  ease  of 
interaction  with  the  aiding.  The  results  indicate  that  the  aiding  was 
considered  easy  to  interact  with  and  desirable  by  the  subjects.  Its  effect 
on  performance  improvement  was  perceived  to  be  from  moderate  to  large.  The 
subjects  perceive  the  aiding  to  be  relatively  more  effective  and  more 
desirable  with  a high  subsystem  arrival  rate  or  a high  control  involvement 
situation.  They,  however,  did  not  feel  that  it  was  more  difficult  to 
interact  with  the  aiding  in  those  situations.  In  fact,  all  the  subjects  were 
quite  in  favor  of  both  the  aiding  scheme  used  in  the  experimental  situation 
and  the  general  computer  aiding  idea.  More  analyses  of  performance  measures 
are  discussed  by  Chu  in  his  thesis  [7]. 


The  empirical  data  were  compared  with  simulation  results  from  the 
queueing  model  of  pilot  decision  making  in  computer  aided  situation  discussed 
earlier.  This  allowed  an  evaluation  of  the  model's  ability  to  represent  the 
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given  situation.  The  comparison  of  subsystem  Waiting  statistic^  is  shown  in 
Table  2. 

Table  2.  Comparison  of  Waiting  Time* 


Arrival  Aiding 

Rate  Type 

Autopilot  Mode 
Low  No  Aiding 

Low  Aiding 

High  No  Aiding 

High  Aiding 

Manual  Mode 


Low 

Low 

High 

High 


Mo  Aiding 
Aiding 
No  Aiding 
Aiding 


Autopilot  Malfunction  Mode 
Low  Mo  Aid^ing 

Low  Aiding 

Low  Adaptive  Aiding 

High  Mo  Aiding 

High  Aiding 

High  Adaptive  Aiding 


Mean 

Standard  Deviation 

Model 

Data 

Model 

Data 

9.73 

9.71 

5.39 

6.04 

9.3“ 

9.82 

, 4.30 

5.13 

14.71 

15.79 

13.46 

14.21 

13.79 

13.16 

12.00^ 

7.43 

20.13 

23.62 

16.24 

23.53 

17.56 

17.17 

10.26 

11.31 

32.87 

27.81 

45.51 

28.64 

19.58 

19.19 

11.85 

12.17 

le 

12.00 

14.25 

8.85 

13.81 

11.13 

12.84 

6.79 

10.52 

10.25 

10.68 

4.91 

5.52 

17.47 

19.03 

18.96 

21.16 

13.66 

15.52 

8.52 

11.55 

12.32 

13.25 

7.10 

8.33 

In  the  model,  a Poison  distribution  of  control  event  arrivals  and  an 
Erlang  distribution  of  control  service  times  with  shape  parameter  ks2.  were 
assumed.  To  generate  the  results  in  Table  2,  the  values  of  0.1  sec**'  (in 
manual  mode)  and  0.16  (in  malfunction  mode)  were  used  as  mean  control  arrival 
rates,  and  0.4?  and  0.34  as  mean  control  service  rates.  These  values  were 
obtained  by  analyzing  subject's  aileron  control  input  and,  serve  as  a first 
approximation . 

The  results  compare  reasonably  well.  All  parameters  in  the  model  were 
empirically  measured  and  no  adjustments  were  made.  The  model  predicts 
performance  in  autopilot  mode  very  well.  A better  estimate  of  control  task 
parameters  will  surely  improve  the  model  accuracy  in  manual  control  and 
autopilot  malfunction  modes. 


CONCLUSION 

The  experimental  results  show  that  all  the  experimental  variables,  i.e., 
the  subsystem  arrival  rates,  the  control  task  Involvement,  and  the 
availability  of  computer  aiding,  were  statistically  significant  in  terms  of 
affecting  the  performance  measures  of  interest,  mainly,  the  subsystem  delays, 
and  subjective  effort  ratings.  It  was  shown  that  the  aiding  enhanced  system 


689 


performance  In  terms  of  subsystem  average  delays  and  subjective  effort 
ratings.  The  adaptive  aiding  policy  was  shovm  to  further  reduce  subsystem 
waiting  time. 

The  queueing  model  fits  the  experiment  result  reasonably  well.  Further 
exploration  of  control  task  preemption  is  needed  to  improve  model  accuracy. 
The  model  also  provides  the  capability  to  predict  the  server  occupancy  for 
different  task  situations.  Included  in  the  future  work  will  be  a teat  of  the 
correlation  between  this  server  occupancy  measure  and  the  subjective  effort 
ratings  to  determine  if  this  measure  may  effectively  serve  as  a workload 
indicator. 

Finally,  the  computer-aided  flight  management  situation  will  next  be 
implemented  in  an  aircraft  simulator  where  regular  pilots  will  be  used  as 
subjects. 


REFERENCES 

1.  Wempe,  T.E.,  "Flight  Management  - Pilot  Procedures  and  System  Interfaces 
for  the  1980  - 1990’s",  AIAA  Paper  No.  74-1297,  AIAA  Life  Science  and 
System  Conference,  November  1974. 

2.  Chu,  Y.  and  Rouse,  W.B.,  "Optimal  Adaptive  Allocation  of  Decision  Making 
Responsibility  between  Human  and  Computer  in  Multi-task  Situations" , 
Proceedings  of  the  International  Conference  on  Cybernetics  and  Society, 
pp.  168-175,  September  1977. 

3.  Greenstein,  J.S.  and  Rouse,  H.B.,  "A  Model  of  Event  Detection  in 
Multiple  Process  Monitoring  Situations" , Proceedings  of  the  Fourteenth 
Annual  Conference  on  Manual  Control,  April  1978. 

4.  Bell,  C.E.,  "Optimal  Operation  of  an  M/G/1  Priority  Queue  with  Removable 
Server",  Operations  Research,  21-6,  1973»  PP.  1281-1290. 

5.  Walden,  R.  S.  and  Rouse,  W.B.,  "A  Queueing  Model  of  Pilot  Decision 
Making  in  a Multi-task  Flight  Management  Situation",  Proceedings  of  the 
Thirteenth  Annual  Conference  on  Manual  Control,  pp.  222-236,  June  1977. 

6.  Rouse,  W.B. , Chu,  Y.,  and  Walden,  R.S.,  "An  Experimental  Situation  for 
Study  of  Pilot  Interaction  with  Automated  Airborne  Decision  Making 
Systems",  Proceedings  of  the  Twelfth  Annual  Conference  on  Manual  Control, 
May  1976,  NASA  TM  X-73,  170,  pp.  39-44. 

7.  Chu,  Y.,  Adaptive  Allocation  of  Decision  Making  Responsibility  between 
Human  and  Computer  in  the  Multi-task  Situations",  Ph.D.  Thesis  in 
progress.  University  of  Illinois,  Urbana,  Illinois. 


690 


SESSION  L;  WORKLOAD 

Chairman:  T.  Sheridan 


691 


N79-15634 

* 

TIME  ESTIMATION  AS  A SECONDARY  TASK  TO  MEASURE  WORKLOAD; 

SUMMARY  OF  RESEARCH 

Sandra  G.  Hart*  Duncan  McPherson**  Leslie  L.  Loomis** 

University  of  Utah  University  of  California  San  Jose  State  University 
Salt  Lake  City,  Utah  Berkeley,  California  San  Jose,  California 

Abstract 

This  paper  outlines  the  results  of  a series  of  experiments  designed  to 
evaluate  the  utility  of  time  estimation  as  a secondary  measure  of  piloting 
workload.  Actively  produced  intervals  of  time  were  found  to  Increase  In 
length  and  variability,  whereas  retrospectively  produced  Intervals  decreased 
in  length  although  they  also  Increased  in  variability  with  the  addition  of  a 
variety  of  flight-related  tasks.  If  pilots  counted  aloud  while  making  a 
production,  however,  the  Impact  of  concurrent  activity  was  minimized,  at 
least  for  the  moderately  demanding  primary  tasks  that  were  selected.  The 
effects  of  feedback  on  estimation  accuracy  and  consistency  were  greatly 
enhanced  if  a counting  or  tapping  production  technique  was  used.  This 
compares  with  the  minimal  effect  that  feedback  had  when  no  overt  timekeeping 
technique  was  used. 

Actively  made  verbal  estimates  of  sessions  filled  x^lth  different  activi- 
ties decreased  in  length  as  the  amount  and  complexity  of  activities  performed 
during  the  Interval  were  increased.  Retrospectively  made  verbal  estimates, 
however.  Increased  in  length  as  the  amount  and  complexity  of  activities 
perfomed  during  the  Interval  were  Increased.  These  results  support  the 
suggestion  that  time  estimation  provides  a useful  index  of  the  workload 
involved  in  performing  concurrent  tasks. 


* Supported  by  NASA  Grant  NGR-45-003-108  to  the  University  of  Utah. 
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INTRODUCTION 


The  wor|:load  involved  in  performing  different:  manual  control  and  decision 
making ‘ tasks  is  often  difficult  to  measure  within  a single  task  or  to  compare 
between  diff^ent  tasks.  It  is  difficult  to  infer  an  operator's  workload  from 
.^  hls  measurable  {feirformance  because:  1)  individuals  may  compensate  for  addi- 

tlonal  task  load  by  working  harder,  resulting  in  little  measurable  variation 
in  performance  and  2)  the  total  workload  is  composed  of  a variety  of  sub tasks 
such , that  performance  on  any  one  may  or  may  not  reflect  varying  degrees  of 
task  load  in  the  others.  In  addition,  different  measurement  techniques 
may  be  required  to  determine  subtask-specific  variation  in  workload. 

The  purpose  of  this  research  program  was  to  develop  a battery  of 
primary  task  indices  and  unobtrusive  secondary  tasks  that  would  specif- 
ically measure  the  load  imposed  by  different  subtasks  that  make  up  the 
total  piloting  task  in  order  to  measure  the  overall  workload  in  real  and 
simulated  flight.  Performance  on  secondary  tasks  is  often  used  as  an 
index  of  primary  task  workload.  Secondary  tasks  that  are  commonly  used  often 
load  the  operator  to  determine  his  remaining  capacity  to  perform  additional 
tasks  while  performing  the  primary  task.  However,  it  was  decided  that  tasks 
selected  for  inclusion  in  the  workload  assessment  battery  should  be  unobtru- 
sive and  measure  primary  task  load  with  minimal  Interference.  The  tasks  also 
should  be  similar  to  tasks  that  are  normally  performed  in  flight,  easily 
learned,  implemented  and  scored. 

The  results  of  this  research  have  suggested  time  estimation  as  one 
such  secondary  measure  of  the  cognitive  demands  of  piloting  because  it  has 
been  shown  that  an  individual's  ability  to  estimate  Intervals  of  time  varies 
as  a function  of  concurrent  task  load.  Time  estimation  is  a task  that  is 
normally  performed  in  flight.  It  is  unobtrusive,  easily  learned,  implemented 
and  scored  and  is  not  altered  by  repeated  presentations  unless  knowledge  of 
results  is  given. 
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Intra-  and  Inter-Subject  Variability 

Although  individuals  tend  to  be  consistent  in  the  length  of  their 
time  estimates,  there  are  large  differences  among  different  individuals. 

For  this  reason,  each  subject  should  be  used  as  hlsi^own  control:  estimates 

obtained  under  different  conditions  of  primary  task  load  can  be  most  easily  ' 
and  unambiguously  analyzed  by  comparison  with  estimates  obtained  from  the 
same  subject  in  the  absence  of  concurrent  task  demands.  Individual  estimation 
accuracy  seems  to  be  a less  important  measure  than  are  the  direction  of  change 
in  the  length  of  estimates  and  the  Increase  in  variability  of  estimates  with 
the  addition  of  a primary  task. 

Estimation  Measurement  Method 

Four  methods  have  been  used  extensively  to  measure  an  individual's 
ability  to  estimate  or  produce  specified  Intervals  of  clock  time.  The 
verbal  estimation  method  requires  that  individuals  vocalize  or  record 
their  judgement  of  the  duration  of  an  operationally  presented  Interval. 

The  production  method  requires  that  subjects  physically  generate  an 
interval  whose  duration  is  specified  by  the  experimenter.  The  repro- 
duction method,  which  combines  elements  of  verbal  estimation  and  produc- 
tion, requires  the  operational  production  of  an  interval  whose  duration 
was  presented  operationally.  The  method  of  comparison  involves  a 
relative  judgement  between  the  durations  of  two  or  more  operationally 
presented  Intervals. 


Estimation  Mode 

Rather  than  being  perceived  directly,  the  temporal  aspects  of 
experiences  are  inferred  or  deduced  from  the  events  that  occur  in 
time.  Man  has  adopted  objective  standards  and  labels  to  allow 
quantification  of  and  communication  about  temporal  experiences  because 
of  the  difficulties  Involved  in  dealing  with  time  in  the  abstract. 
Individuals  represent  durations  subjectively  by  correlating  personally 
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Figure  1 


BASELINE  ESTIMATES  COMPARED  TO  THOSE 
PRODUCED  DURING  COMPENSATORY  TRACKING 


SKEWNESS  CENTRAL  TENDENCY  DISPERSION 


experienced  events  with  objective  teiporal  standards  or  rules,  such  as 
clocks. 

Active  Mode 

When  individuals  must  produce  a specific  duration  or  verbally 

♦ 

estimate  the  length  of  a presented  interval  unaided  by  an  objective 
timing  device,  they  may  rely  on  impressions  of  past  events  or  mentally 
or  physically  replay  or  generate  a sequence  of  events  that  is  believed 
to  last  a specific  interval  of  time  in  order  tO  make  the  temporal 
dimension  of  the  Interval  concrete.  This  mode  of  estimation  has  been 
referred  to  as  active  estimation  (ref.  1). 

Retrospective  mode 

Individuals  may  also  make  temporal  estimates  without  attending  to 
time  as  it  passes.  They  may  estimate  the  duration  of  an  Interval  at 
its  conclusion  by  comparing  the  number  and  complexity  of  events  that 
occuired  during  the  interval  with  remembered  durations  of  Intervals 
similarly  filled  (ref.  2).  This  mode  of  estimation  has  been  referred 
to  as  retrospective  estimation  (ref.  1). 

Influence  of  Concurrent  Activity  on  Active  Estimation 

The  attention  demanded  by  concurrent  activity  tends  to  interfere 
with  active  estimation.  Whenever  attention  is  diverted  from  active 
estimation,  time  passes  unnoticed  so  that  individuals  may  wait  too 
long  to  terminate  a production  or  verbally  underestimate  the  length 
of  the  Interval. 

Active  productions 

Hart  and  McPherson  (ref.  3)  and  Hart  and  Simpson  (ref.  4)  have 
shown  that  subjects  do  Indeed  wait  too  long  to  terminate  their  pro- 
ductions when  distracted  from  active  time  estimation  by  competing 
simple  compensatory  tracking  tasks  (fig.  1)  or  speech  recognition. 

A series  of  stylized  representations  of  the  mean  length  of  10  sec 
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Figure  2 


REPRESENTATIVE  DISTRIBUTIONS  OF  10-SEC  PRODUCED 
DURATIONS:  INFLUENCE  OF  CONCURRENT  ACTIVITY 
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X -14.38 
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RATIO  OF  VERBALLY  ESTIMATED  DURATION 
TO  ACTUAL  SESSION  LENGTH  (n=9) 
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AND  TRACKING 
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productions  obtained  under  dift'erent  experimental  conditions  is  given  in 
figure  2*  Each  distribution's  shape  approximates  that  of  actual  data  obtained 
and  was  drawn  to  Include  three  standard  deviations  about  the  obtained  mean. 

As  the  demands  of  the  concurrent  tracking  and  recognition  tasks  were  increased, 
the  length  of  produced  durations  Increased  by  4 sec  or  more  and  their 
variability  more  than  doubled.  Other,  less  demanding  concurrent  tasks,  such 
as  monitoring  continuous  aviation  weather  broadcasts,  were  also  associated 
with  an  Increase  in  the  central  tendency  and  variability  of  estimate 
distributions,  but  to  a lesser  degree,  as  one  would  expect  from  their  less 
demanding  nature. 

Active  verbal  estimates 

Hart  (ref.  5)  and  Hart,  McPherson,  Krelfeldt,  and  Wempe  (ref.  6) 
found  that  actively  made  verbal  estimates  decreased  in  length  with 
the  addition  of  either  a simple  compensatory  tracking  task  (fig.  3) 
or  a complex  multi-manned  flight  simulation  (fig.  4b).  The  more 
difficult  levels  of  each  task  were  associated  with  the  shortest 
active  verbal  estimates.  This  is  consistent  with  the  finding  that 
active  verbal  estimation  and  active  production  are  reciprocally 
related,  and  the  observed  directions  of  change  in  estimated  and  pro- 
duced durations  are  both  the  consequence  of  underestimation  of  the 
passage  of  tl^e. 

Influence  of  Concurrent  Activity  on  Retrospectivi  Estimation 

As  the  attention  demands  of  a primary  task  increase,  there  is  less 
and  less  attention  available  for  time  estimation.  When  active  estimation 
becomes  impossible  the  retrospective  mode  of  estimation  becomes  necessary. 

Here,  one  presumably  remembers  the  events  that  occurred  during  the  Interval, 
compares  them  to  other  experiences  with  known  duration,  and  then  verbally 
estimates  the  duration  of  the  interval  or  decides  whether  or  not  it  is 
time  to  terminate  a production.  As  the  number  and  complexity  of  events 
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Figure  4 


A.  PROPORTION  OF  VERBAL  ESTIMATES  OF  THE  DURATION  OF  FINAL 
APPROACHES  THAT  PILOTS  REPORTED  MAKING  ACTIVEL  i AND 
RETROSPECTIVELY  (n  = 9) 


AVERAGE  RATIO  OF  ESTIMATED  DURATION  TO  ACTUAL  DURATION 
FOR  ACTIVE  AND  RETROSPECTIVE  ESTIMATES 
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that  fill  the  interval  are  Increased,  there  is  a tendency  toward  over- 
estimation  of  the  amount  of  time  that  has  passed  resulting  in  the  termina- 
tion of  produced  durations  too  soon  or  the  verbal  overestimation  of  elapsed 
time.  Note  that  the  directions  of  change  in  retrospectively  verbally 
estimated  and  produced  durations  are  the  opposite  of  those  obtained  with 
active  estimation  and  production  and  again  the  length  of  verbal  estimates 
and  productions  are  reciprocally  related. 

Retrospective  productions 

Hart  and  McPherson  (ref.  3)  have  shown  that  the  central  tendency  of 
10  sec  productions,  obtained  from  pilots  during  simulated  flight,  decreased 
in  length,  as  predicted,  and  the  variability  of  the  produced  durations 
increased  in  comparison  to  estimates  obtained  with  no  competing  activity, 
(fig.  5)  Pilots  reported  that  active  estimation  was  difficult,  resulting 
in  their  use  of  the  retrospective  mode.  The  distributions  of  retrospec- 
tively made  productions  were  also  positively  skewed  due  to  a few  very  long 
estimates  which  resulted  from  the  estimation  task  occasionally  being 
forgotten  under  conditions  of  high  concurrent  task  load. 

Retrospective  verbal  estimates 

Following  a complex  multi-manned  simulation  flight,  (ref.  6)  pilot 
indicated  that  66%  of  their  estimates  of  the  length  of  time  taken  to  fly 
the  final  two  miles  of  an  approach  were  made  retrospectively  and  that  the 
proportion  of  retrospectively  made  estimates  Increased  as  the  difficulty 
of  the  approach  Increased,  (fig.  4a)  Retrospectively  made  estimates 
were  consistently  longer  than  were  estimates  that  pilots  reported  that 
they  had  made  actively  as  predicted,  (fig.  4b) 

Interaction  of  Estimation  Technique  and  Concurrent  Task 

Within  the  active  mode  of  estimation  there  are  many  timekeeping 
techniques  available.  A standardize'*,  rhythmic  temporal  metric  (such  as 
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tapping)  not  only  fixes  an  individual's  attention  on  the  time  estimation 
task,  which  is  otherwise  difficult  to  do  for  a task  as  abstract  and 
stimulus-deficient  as  time  estimation,  but  also  provides  a concrete, 
repeatable  way  to  keep  track  of  time.  Timekeeping  techniques  that  are 
not  externalized,  however,  are  more  easily  disrupted  by  additional, 
more  compelling  activities  and  are  less  stable  across  time.  Some 
of  the  estimation  techniques  that  subjects  have  reported  using  to  keep 
track  of  time  include  counting,  tapping,  mentally  replaying 
a phrase  of  music  estimated  to  have  the  appropriate  duration,  mentally 
rehearsing  the  pre-flight  checklist  for  a helicopter,  counting  heart 
beats  or  breaths,  picturing  the  dial  of  a clock  with  a second  hand  moving 
around  it,  or  "just  waiting"  for  10  sec.  Of  these  techniques,  those 
that  are  externalized,  such  as  counting,  provide  standard,  repeatable 
units  with  which  to  mark  off  intervals  of  time  resulting  in  Improved 
estimation  stability.  Mental  rehearsal  of  remembered  experiences 
judged  to  have  the  appropriate  duration  resulted  in  less  stable 
productions,  because  the  interval  that  was  repeated  may  or  may  not  have 
lasted  the  appropriate  duration.  Further,  it  is  difficult  to  control 
the  rate  at  which  one's  mind  steps  through  a memory. 

Hart,  Loomis  and  Wempe  (ref.  7)  found  that  when  attention  was 
focused  on  a time  production  task  by  requiring  subjects  to  rhythmically 
count  aloud  1-sec  intervals,  production  accuracy  and  consistency  were 
not  affected  by  the  addition  of  a concurrent  task.  (fig.  6 and  fig,  7) 

With  no  overt  counting,  however,  the  length  and  variability  of  produced 
durations  increased  significantly  with  the  addition  of  a tracking  task, 
replicating  earlier  results  (ref.  3).  Because  performance  on  the  track- 
ing task  was  the  same  with  both  productions  techniques,  it  appears  that 
the  shift  in  attention  away  from  time  production  found  with  the  no-counting 
technique  was  not  because  subjects  could  not  innately  perform  both  tasks 
but  merely  that  they  in  fact  did  not.  When  attention  was  focused  on  the 
time  production  task  by  the  counting  technique,  production  accuracy  was 
not  degraded  and  there  was  no  concomitant  degradation  of  tracking  task 
performance. 
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REPRESENTATIVE  DISTRIBUTIONS  OF  PRODUCED 
DURATIONS:  INTERACTION  BETWEEN  ESTIMATION 
TECHNIQUE  AND  INFLUENCE  OF  CONCURRENT  ACTIVITY 
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Figure  7 
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It  is  likely  that  more  demanding  concurrent  activity,  such  as 
simulated  flight,  would  also  Impact  the  consistency  of  durations 
produced  with  a counting  technique.  However,  no  such  effects  were  found 
with  the  moderately  demanding  tracking  tasks  that  were  used. 

Interaction  of  Estimation  Technique  and  Feedback 

If  the  ability  to  estimate  and  produce  intervals  of  time  Is  learned, 
then  It  Is  likely  that  knowledge  of  results  (feedback)  should  enhance 
timekeeping  accuracy  and  consistency.  In  addition,  the  use  of  estimation 
techniques  that  provide  rhythmic  division  of  an  interval  into  standard, 
repeatable  units  should  focus  attention  on  timekeeping  and  make  the 
temporal  dimension  of  the  Interval  more  concrete,  thereby  enhancing 
an  individual's  ability  to  take  advantage  of  feedback. 

In  a recent  study.  Hart,  Loomis  and  Wempe  (ref.  8)  found  that 
individuals,  using  estimation  techniques  that  did  not  Involve  some  sort 
of  overt  counting,  made  less  efficient  Initial  use  of  feedback  and  did 
not  experience  any  long  term  benefits  from  feedback.  Overall  accuracy 
of  10-sec  productions,  but  not  variability,  was  improved  significantly 
by  the  presentation  of  feedback,  with  a rapid  return  to  prefeedback 
performance  levels  when  feedback  was  removed,  (fig.  8 and  fig.  9). 

During  feedback,  subjects  repeatedly  overcorrected.  If  told  that  one 
production  was  too  long,  the  next  production  was  typically  too  short  and 
vice  versa.  Even  after  30  trials  with  feedback  following  every  production, 
subjects  were  unable  to  estimate  accurately  from  trial  to  trial  even 
though  their  estimate  durations  appeared  to  be  accurate  overall.  If 
the  subjects  were  Instructed  to  rhythmically  tap  a button  at  1-sec 
intervals  in  order  to  produce  a series  of  10-sec  durations,  both 
accuracy  and  variability  were  improved  significantly  by  the  addition 
of  £eedbi«k.  This  Improvement  persisted  for  at  least  as  long  as  30 
additional  trials  after  feedback  was  removed.  With  this  production 
technique,  subjects  were  able  to  maintain  consistent  and  accurate 
estimates  from  trial  to  trial,  and  did  not  overcorrect  as  they  had 
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Figure  8. 


REPRESENTATIVE  DISTRIBUTIONS  OF  10-SEC  PRODUCED 
DURATIONS:  INFLUENCE  OF  KNOWLEDGE  OF  RESULTS 
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with  the  no-counting  technique.  The  data  suggest  that  tapping  rhythmic- 
ally not  only  provides  a standardized  repeatable  temporal  metric,  but 
also  flxet  subject’s  attention  on  the  time  production  task,  which 
together  coiiibine  to  enable  subjects  to  use  feedback  more  effectively. 

Conclusion 

As  a result  of  the  foregoing  research  effort,  several  recommendations 
can  be  made  concerning  the  use  of  time  estimation  as  a secondary 
measure  of  the  attention  demands  of  a primary  task. 

Method 

The  production  of  brief  Intervals  of  time  appears  to  be  the  roost 
useful  experimental  method.  The  dur'  on  and  variability  of  time 
productions  in  the  range  of  1 to  30  sec  have  been  shown  to  reflect  the 
attention  demands  of  primary  manual  control,  message  recognition,  and 
simulated  flight  tasks.  Relatively  brief  Intervals  should  be  used  so 
that  the  primary  task  load  remains  reasonably  uniform  and  descrlbable 
during  the  produced  Interval. 

The  verbal  estimation  method  also  shows  some  promise  as  a secondary 
measure  of  primary  task  workload.  Its  primary  advantage  over  the  production 
method  is  ease  of  implementation.  Its  primary  disadvantage  is  that  subjects 
tend  to  round  off  their  estimates,  thereby  losing  precision,  and  their 
responses  tend  to  become  stereotyped  if  a number  of  estimates  are  required. 
This  method  appears  to  have  some  value,  but  is  less  sensitive  than  the 
method  of  production. 

Mode 

Estimation  mode  (active  or  retrospective  production  or  verbal  esti- 
mation) must  also  be  controlled  or  identified  to  obtain  reliable  and 
clear  results  with  a time  estimation  task.  Because  retrospective  produc- 
tions decrease  in  length  with  increasing  task  load  whereas  active  produc- 
tions Increase  in  length,  care  must  be  taken  to  identify  the  mode  of 
production  used.  If  retrospective  and  active  productions  are  combined 
in  an  analysis,  their  direction  of  change  with  the  addition  of  another 
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task  would  tend  to  cancel  out  masking  detailed  changes  In  the  under- 
lying processes. 


Technique 

Timekeeping  techniques  that  are  not  externalized  are  most  easily 
disrupted  by  concurrent  task  demands  and  thus  provide  the  most  useful 
measure  of  primary  task  demands.  Thus,  if  time  production  is  to  be  used 
as  a measure  of  workload,  subjects  should  not  be  allowed  to  use  any  overt 
time  estimation  technique  such  as  tapping  or  counting.  If  estimation 
accuracy  and  consistency  are  required,  however,  an  overt  timekeeping 
technique  should  be  used.  Further  research  is  required  to  determine 
at  what  level  of  concurrent  task  load  the  overt  estimation  technique 
would  also  be  disrupted. 

Feedback 


If  an  overt  timekeeping  technique  is  used,  feedback  is  effective 
in  reducing  both  error  and  variability  after  only  two  or  three  repetitions, 
and  the  effects  of  feedback  last  long  after  it  has  been  removed.  With  no 
overt  timekeeping  technique,  however,  estimation  error  Is  reduced  only  on 
the  average,  and  variability  remains  high  with  a rapid  return  to  pre- 
feedback error  levels  following  removal  of  feedback. 

Data  Analysis 

Time  estimation  performance  is  best  evaluated  relatively.  That  is, 
the  amount  and  direction  of  change  in  estimation  accuracy  and  consistency 
observed  in  the  presence  of  additional  primary  tasks  should  be  compared 
to  estimates  obtained  from  the  same  subject  with  no  additional  activity. 
Care  should  also  be  taken  to  select  the  appropriate  measures  of  central 
tendency  and  variability  as  distributions  of  time  productions  are  often 
positively  skewed,  particularly  when  obtained  in  the  presence  of  competing 
concurrent  activity. 
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